Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5195 originally caused by: Started by upstream project "master-osmo-pcu" build number 5363 originally caused by: Started by upstream project "master-libosmo-gprs" build number 137 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2994 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29315 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5156 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30101 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9260 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5195 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3912 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins7213497480107610701.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 05:28:20 + trial_dir_prefix=trial- + rm -rf trial-2399 trial-2399-bin.tgz trial-2399-run.tgz + trial_dir=trial-2400 + mkdir -p trial-2400 + mv open5gs.build-8.tgz osmo-bsc.build-17686.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2994.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3912.tgz osmo-pcu-sysmo.build-5195.tgz osmo-pcu.build-5156.tgz osmo-sgsn.build-30101.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2400 + cat open5gs.build-8.md5 osmo-bsc.build-17686.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2994.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3912.md5 osmo-pcu-sysmo.build-5195.md5 osmo-pcu.build-5156.md5 osmo-sgsn.build-30101.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17686.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2994.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3912.md5 osmo-pcu-sysmo.build-5195.md5 osmo-pcu.build-5156.md5 osmo-sgsn.build-30101.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2400 combinations: None trial: 'trial-2400' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2400 -------------------------------------------------------------------------------------------- 05:28:31.619890 tst trial-2400: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/log --------------------------------------------------------------------- trial-2400 nitb_sms:sysmo --------------------------------------------------------------------- 05:30:39.582435 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:39.586221 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 05:30:39.607053 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 05:30:39.613880 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 05:30:39.667465 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 05:30:39.689522 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 05:30:39.696380 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 05:30:40.232632 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 05:30:40.238520 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 05:30:40.249689 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 05:30:40.625508 tst mo_mt_sms.py: using LAC 38735 05:30:40.864651 tst mo_mt_sms.py: using RAC 230 05:30:40.978937 tst mo_mt_sms.py: using CellId 38735 05:30:41.091678 tst mo_mt_sms.py: using BVCI 38736 05:30:41.196055 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 05:30:41.369298 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 05:30:41.486218 tst mo_mt_sms.py:9: start nitb and bts... 05:30:41.701489 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:30:44.023082 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12068): Launched 05:30:44.339934 run osmo-nitb_10.42.42.2(pid=12069): Launched 05:30:44.513521 run osmo-nitb_10.42.42.2(pid=12069): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12069)] 05:30:44.644262 run osmo-nitb_10.42.42.2(pid=12069): stdout: | (launched: 2022-12-14_05:30:44.282454) 05:30:44.776460 run osmo-nitb_10.42.42.2(pid=12069): stderr: | (launched: 2022-12-14_05:30:44.329921) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:44.909293 run osmo-nitb_10.42.42.2(pid=12069): stdout: | (launched: 2022-12-14_05:30:44.282454) 05:30:45.035636 run osmo-nitb_10.42.42.2(pid=12069): stderr: | (launched: 2022-12-14_05:30:44.329921) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:45.187560 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12069): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12069) [trial-2400↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12069)] [trial-2400↪nitb_sms:sysmo↪mo_mt_sms.py:11] 05:30:45.196304 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 05:30:45.203405 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12068): Terminating (SIGTERM) 05:30:45.413395 --- ParallelTerminationStrategy: PID 12068 died... 05:30:45.434260 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12068): Terminated: ok {rc=0} 05:30:45.521623 bus /sierra_3: Setting Powered False 05:30:46.623220 bus /sierra_3: Setting Powered False 05:30:47.743841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:sysmo --------------------------------------------------------------------- 05:30:48.920749 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:48.924619 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 05:30:48.944898 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 05:30:48.972047 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 05:30:49.022534 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 05:30:49.042931 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 05:30:49.069255 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 05:30:49.615173 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:sysmo mo_mt_sms.py ---------------------------------------------- 05:30:49.620001 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:49.630477 tst sms:sysmo: Using 1 x bts (candidates: 1) 05:30:49.666555 tst mo_mt_sms.py: using LAC 38736 05:30:49.792326 tst mo_mt_sms.py: using RAC 231 05:30:49.915838 tst mo_mt_sms.py: using CellId 38736 05:30:50.038915 tst mo_mt_sms.py: using BVCI 38737 05:30:50.154161 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:50.164853 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:50.175592 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:50.186288 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:50.197077 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:50.207834 tst sms:sysmo: Using 1 x modem (candidates: 2) 05:30:50.328117 tst sms:sysmo: Using 1 x modem (candidates: 2) 05:30:50.446579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:52.185431 run create_hlr_db(pid=12076): Launched 05:30:52.314845 bus /sierra_2: Setting Powered False 05:30:53.378339 run create_hlr_db(pid=12076): Terminated: ok {rc=0} 05:30:53.806676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12079): Launched 05:30:54.104914 run osmo-hlr_10.42.42.2(pid=12080): Launched 05:30:54.220057 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:56.801331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12082): Launched 05:30:57.119742 run osmo-stp_10.42.42.5(pid=12083): Launched 05:30:57.241643 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:02.675710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12085): Launched 05:31:02.994090 run osmo-msc_10.42.42.6(pid=12086): Launched 05:31:03.184395 run osmo-stp_10.42.42.5(pid=12083): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12083)] 05:31:03.318985 run osmo-stp_10.42.42.5(pid=12083): stdout: | (launched: 2022-12-14_05:30:57.061921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:03.455094 run osmo-stp_10.42.42.5(pid=12083): stderr: | 20221214053057250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053057250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053057251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053057251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053057252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053057252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053057252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:03.581121 run osmo-stp_10.42.42.5(pid=12083): stdout: | (launched: 2022-12-14_05:30:57.061921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:03.706839 run osmo-stp_10.42.42.5(pid=12083): stderr: | 20221214053057250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053057250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053057251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053057251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053057252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053057252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053057252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:03.849146 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12083): Process ended prematurely: osmo-stp_10.42.42.5(pid=12083) [trial-2400↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12083)] [trial-2400↪sms:sysmo↪mo_mt_sms.py:16] 05:31:03.857459 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 05:31:03.883359 run osmo-hlr_10.42.42.2(pid=12080): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12080)] 05:31:03.931385 run osmo-hlr_10.42.42.2(pid=12080): stdout: | (launched: 2022-12-14_05:30:54.050070) 05:31:03.981056 run osmo-hlr_10.42.42.2(pid=12080): stderr: | 20221214053054222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053054222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053054223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053054223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053054223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053054223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053054236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053054244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053054244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053054244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:04.049857 run osmo-msc_10.42.42.6(pid=12086): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12086)] 05:31:04.097238 run osmo-msc_10.42.42.6(pid=12086): stdout: | (launched: 2022-12-14_05:31:02.936153) 05:31:04.146575 run osmo-msc_10.42.42.6(pid=12086): stderr: | 20221214053103318 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053103319 DLGLOBAL DEBUG validating counter group 0x7eff44f5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053103319 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053103319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053103319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053103319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053103321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053103321 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053103321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053103321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:04.196264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12079): Terminating (SIGTERM) 05:31:04.236267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12082): Terminating (SIGTERM) 05:31:04.276281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12085): Terminating (SIGTERM) 05:31:04.316305 --- ParallelTerminationStrategy: PID 12079 died... 05:31:04.335656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12079): Terminated: ok {rc=0} 05:31:04.380067 --- ParallelTerminationStrategy: PID 12082 died... 05:31:04.398982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12082): Terminated: ok {rc=0} 05:31:04.443240 --- ParallelTerminationStrategy: PID 12085 died... 05:31:04.462125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12085): Terminated: ok {rc=0} 05:31:04.547915 bus /sierra_3: Setting Powered False 05:31:05.647391 bus /sierra_3: Setting Powered False 05:31:06.762156 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:sysmo --------------------------------------------------------------------- 05:31:07.983925 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:07.988214 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 05:31:08.009344 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 05:31:08.016243 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 05:31:08.050626 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 05:31:08.071589 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 05:31:08.078351 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 05:31:08.656672 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 05:31:08.665027 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 05:31:08.679354 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 05:31:08.733961 tst assert_extension.py: using LAC 38737 05:31:08.867968 tst assert_extension.py: using RAC 232 05:31:08.989762 tst assert_extension.py: using CellId 38737 05:31:09.115276 tst assert_extension.py: using BVCI 38738 05:31:09.232752 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 05:31:09.347900 tst assert_extension.py:10: start nitb and bts... 05:31:09.549235 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:31:10.157335 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12091): Launched 05:31:10.455450 run osmo-nitb_10.42.42.2(pid=12092): Launched 05:31:10.620486 run osmo-nitb_10.42.42.2(pid=12092): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12092)] 05:31:10.754231 run osmo-nitb_10.42.42.2(pid=12092): stdout: | (launched: 2022-12-14_05:31:10.400784) 05:31:10.889751 run osmo-nitb_10.42.42.2(pid=12092): stderr: | (launched: 2022-12-14_05:31:10.444813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:31:11.025971 run osmo-nitb_10.42.42.2(pid=12092): stdout: | (launched: 2022-12-14_05:31:10.400784) 05:31:11.156143 run osmo-nitb_10.42.42.2(pid=12092): stderr: | (launched: 2022-12-14_05:31:10.444813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12092) [trial-2400↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12092)] 05:31:11.567749 tst osmo-nitb_10.42.42.2(pid=12092): stdout: | (launched: 2022-12-14_05:31:10.400784) 05:31:11.688426 tst osmo-nitb_10.42.42.2(pid=12092): stderr: | (launched: 2022-12-14_05:31:10.444813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:31:11.830586 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12092) [trial-2400↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12092)] [trial-2400↪nitb_ussd:sysmo↪assert_extension.py:12] 05:31:11.839141 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:31:11.845949 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12091): Terminating (SIGTERM) 05:31:12.055456 --- ParallelTerminationStrategy: PID 12091 died... 05:31:12.076101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12091): Terminated: ok {rc=0} 05:31:12.161503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:sysmo --------------------------------------------------------------------- 05:31:13.489291 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:13.494026 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 05:31:13.516596 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 05:31:13.543804 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 05:31:13.578502 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 05:31:13.600111 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 05:31:13.626755 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 05:31:14.156530 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:sysmo assert_extension.py ---------------------------------------------- 05:31:14.162073 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:31:14.173209 tst ussd:sysmo: Using 1 x bts (candidates: 1) 05:31:14.210520 tst assert_extension.py: using LAC 38738 05:31:14.336343 tst assert_extension.py: using RAC 233 05:31:14.460662 tst assert_extension.py: using CellId 38738 05:31:14.584567 tst assert_extension.py: using BVCI 38739 05:31:14.700649 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:31:14.711535 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:31:14.722324 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:31:14.732931 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:31:14.743653 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:31:14.754721 tst ussd:sysmo: Using 1 x modem (candidates: 1) 05:31:14.870387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:15.334331 run create_hlr_db(pid=12096): Launched 05:31:15.448772 bus /sierra_2: Setting Powered False 05:31:16.521782 run create_hlr_db(pid=12096): Terminated: ok {rc=0} 05:31:17.047360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12098): Launched 05:31:17.377372 run osmo-hlr_10.42.42.2(pid=12099): Launched 05:31:17.501968 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:18.055178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12101): Launched 05:31:18.375479 run osmo-stp_10.42.42.5(pid=12102): Launched 05:31:18.497118 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:19.073438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12104): Launched 05:31:19.392488 run osmo-msc_10.42.42.6(pid=12105): Launched 05:31:19.571296 run osmo-stp_10.42.42.5(pid=12102): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12102)] 05:31:19.707014 run osmo-stp_10.42.42.5(pid=12102): stdout: | (launched: 2022-12-14_05:31:18.317375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:19.842345 run osmo-stp_10.42.42.5(pid=12102): stderr: | 20221214053118506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053118506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053118506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053118506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053118507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053118507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053118507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:19.977141 run osmo-stp_10.42.42.5(pid=12102): stdout: | (launched: 2022-12-14_05:31:18.317375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:20.105142 run osmo-stp_10.42.42.5(pid=12102): stderr: | 20221214053118506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053118506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053118506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053118506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053118507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053118507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053118507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:20.258448 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12102): Process ended prematurely: osmo-stp_10.42.42.5(pid=12102) [trial-2400↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12102)] [trial-2400↪ussd:sysmo↪assert_extension.py:17] 05:31:20.267144 tst assert_extension.py:17: Test FAILED (6.1 sec) 05:31:20.294163 run osmo-hlr_10.42.42.2(pid=12099): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12099)] 05:31:20.344225 run osmo-hlr_10.42.42.2(pid=12099): stdout: | (launched: 2022-12-14_05:31:17.319300) 05:31:20.396032 run osmo-hlr_10.42.42.2(pid=12099): stderr: | 20221214053117512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053117512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053117512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053117512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053117512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053117513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053117574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053117584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053117584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053117584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:20.468010 run osmo-msc_10.42.42.6(pid=12105): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12105)] 05:31:20.518144 run osmo-msc_10.42.42.6(pid=12105): stdout: | (launched: 2022-12-14_05:31:19.334302) 05:31:20.569820 run osmo-msc_10.42.42.6(pid=12105): stderr: | 20221214053119654 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053119654 DLGLOBAL DEBUG validating counter group 0x7fd412ee9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053119654 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053119654 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053119654 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053119654 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053119656 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053119656 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053119657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053119657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:20.622039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12098): Terminating (SIGTERM) 05:31:20.663756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12101): Terminating (SIGTERM) 05:31:20.705569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12104): Terminating (SIGTERM) 05:31:20.747504 --- ParallelTerminationStrategy: PID 12098 died... 05:31:20.767336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12098): Terminated: ok {rc=0} 05:31:20.813261 --- ParallelTerminationStrategy: PID 12101 died... 05:31:20.832730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12101): Terminated: ok {rc=0} 05:31:20.878783 --- ParallelTerminationStrategy: PID 12104 died... 05:31:20.898198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12104): Terminated: ok {rc=0} 05:31:20.984915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:31:22.174983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:22.181629 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:31:22.202734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:31:22.230297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:31:22.281731 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:31:22.302604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:31:22.329950 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:31:22.881884 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:31:22.937156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:22.948692 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:31:23.005879 tst mo_mt_call.py: using LAC 38739 05:31:23.133829 tst mo_mt_call.py: using RAC 234 05:31:23.260827 tst mo_mt_call.py: using CellId 38739 05:31:23.387992 tst mo_mt_call.py: using BVCI 38740 05:31:23.505350 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:23.516723 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:23.527972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:23.539102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:23.550353 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:23.561593 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:31:23.676044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:31:23.793847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:24.299675 run create_hlr_db(pid=12110): Launched 05:31:24.432307 bus /sierra_2: Setting Powered False 05:31:25.497142 run create_hlr_db(pid=12110): Terminated: ok {rc=0} 05:31:25.951401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12112): Launched 05:31:26.277835 run osmo-hlr_10.42.42.2(pid=12113): Launched 05:31:26.401177 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:26.966667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12115): Launched 05:31:27.292609 run osmo-stp_10.42.42.5(pid=12116): Launched 05:31:27.416053 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:28.005691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12118): Launched 05:31:28.331959 run osmo-msc_10.42.42.6(pid=12119): Launched 05:31:28.512840 run osmo-stp_10.42.42.5(pid=12116): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12116)] 05:31:28.649887 run osmo-stp_10.42.42.5(pid=12116): stdout: | (launched: 2022-12-14_05:31:27.233696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:28.787823 run osmo-stp_10.42.42.5(pid=12116): stderr: | 20221214053127421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053127421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053127422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053127422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053127423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053127423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053127423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:28.923951 run osmo-stp_10.42.42.5(pid=12116): stdout: | (launched: 2022-12-14_05:31:27.233696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:29.053884 run osmo-stp_10.42.42.5(pid=12116): stderr: | 20221214053127421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053127421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053127422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053127422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053127423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053127423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053127423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:29.208791 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12116): Process ended prematurely: osmo-stp_10.42.42.5(pid=12116) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12116)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:31:29.218120 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:31:29.245387 run osmo-hlr_10.42.42.2(pid=12113): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12113)] 05:31:29.295099 run osmo-hlr_10.42.42.2(pid=12113): stdout: | (launched: 2022-12-14_05:31:26.218141) 05:31:29.346814 run osmo-hlr_10.42.42.2(pid=12113): stderr: | 20221214053126414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053126414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053126414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053126414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053126414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053126414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053126427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053126435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053126435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053126435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:29.418632 run osmo-msc_10.42.42.6(pid=12119): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12119)] 05:31:29.468202 run osmo-msc_10.42.42.6(pid=12119): stdout: | (launched: 2022-12-14_05:31:28.272744) 05:31:29.519896 run osmo-msc_10.42.42.6(pid=12119): stderr: | 20221214053128592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053128592 DLGLOBAL DEBUG validating counter group 0x7f698c003c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053128592 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053128592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053128592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053128593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053128594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053128595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053128595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053128595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:29.572165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12112): Terminating (SIGTERM) 05:31:29.613855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12115): Terminating (SIGTERM) 05:31:29.655678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12118): Terminating (SIGTERM) 05:31:29.697941 --- ParallelTerminationStrategy: PID 12112 died... 05:31:29.717763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12112): Terminated: ok {rc=0} 05:31:29.763684 --- ParallelTerminationStrategy: PID 12115 died... 05:31:29.783131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12115): Terminated: ok {rc=0} 05:31:29.828739 --- ParallelTerminationStrategy: PID 12118 died... 05:31:29.848115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12118): Terminated: ok {rc=0} 05:31:29.935388 bus /sierra_3: Setting Powered False 05:31:31.030833 bus /sierra_3: Setting Powered False 05:31:32.151566 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:31:33.302414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:33.314490 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:31:33.372493 tst mo_mt_call_osmux.py: using LAC 38740 05:31:33.501521 tst mo_mt_call_osmux.py: using RAC 235 05:31:33.624103 tst mo_mt_call_osmux.py: using CellId 38740 05:31:33.745394 tst mo_mt_call_osmux.py: using BVCI 38741 05:31:33.855240 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:33.866395 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:33.877454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:33.888158 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:33.899385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:33.910555 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:31:34.025362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:31:34.145225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:34.650702 run create_hlr_db(pid=12121): Launched 05:31:34.783307 bus /sierra_2: Setting Powered False 05:31:35.847213 run create_hlr_db(pid=12121): Terminated: ok {rc=0} 05:31:36.282260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Launched 05:31:36.587647 run osmo-hlr_10.42.42.2(pid=12124): Launched 05:31:36.703983 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:37.240881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12126): Launched 05:31:37.544850 run osmo-stp_10.42.42.5(pid=12127): Launched 05:31:37.660423 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:38.209885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12129): Launched 05:31:38.513681 run osmo-msc_10.42.42.6(pid=12130): Launched 05:31:38.682885 run osmo-stp_10.42.42.5(pid=12127): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12127)] 05:31:38.811740 run osmo-stp_10.42.42.5(pid=12127): stdout: | (launched: 2022-12-14_05:31:37.489124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:38.940638 run osmo-stp_10.42.42.5(pid=12127): stderr: | 20221214053137657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053137657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053137657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053137658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053137658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053137658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053137658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:39.067534 run osmo-stp_10.42.42.5(pid=12127): stdout: | (launched: 2022-12-14_05:31:37.489124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:39.188551 run osmo-stp_10.42.42.5(pid=12127): stderr: | 20221214053137657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053137657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053137657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053137658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053137658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053137658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053137658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:39.333373 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12127): Process ended prematurely: osmo-stp_10.42.42.5(pid=12127) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12127)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:31:39.342409 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:31:39.368788 run osmo-hlr_10.42.42.2(pid=12124): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12124)] 05:31:39.416629 run osmo-hlr_10.42.42.2(pid=12124): stdout: | (launched: 2022-12-14_05:31:36.531897) 05:31:39.465928 run osmo-hlr_10.42.42.2(pid=12124): stderr: | 20221214053136704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053136704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053136704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053136704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053136704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053136704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053136724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053136735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053136735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053136735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:39.535289 run osmo-msc_10.42.42.6(pid=12130): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12130)] 05:31:39.582486 run osmo-msc_10.42.42.6(pid=12130): stdout: | (launched: 2022-12-14_05:31:38.458297) 05:31:39.631570 run osmo-msc_10.42.42.6(pid=12130): stderr: | 20221214053138728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053138728 DLGLOBAL DEBUG validating counter group 0x7f80e9a6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053138728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053138728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053138728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053138728 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053138730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053138731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053138731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053138731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:39.680936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Terminating (SIGTERM) 05:31:39.720473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12126): Terminating (SIGTERM) 05:31:39.760087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12129): Terminating (SIGTERM) 05:31:39.799934 --- ParallelTerminationStrategy: PID 12123 died... 05:31:39.819478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Terminated: ok {rc=0} 05:31:39.863274 --- ParallelTerminationStrategy: PID 12126 died... 05:31:39.881950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12126): Terminated: ok {rc=0} 05:31:39.925494 --- ParallelTerminationStrategy: PID 12129 died... 05:31:39.944208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12129): Terminated: ok {rc=0} 05:31:40.030097 bus /sierra_3: Setting Powered False 05:31:41.128023 bus /sierra_3: Setting Powered False 05:31:42.242004 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:31:43.472121 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:43.479522 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:31:43.500924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:31:43.527893 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:31:43.578390 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:31:43.599334 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:31:43.626786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:31:44.179923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:31:44.230388 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:44.241457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:31:44.298278 tst mo_mt_call.py: using LAC 38741 05:31:44.418975 tst mo_mt_call.py: using RAC 236 05:31:44.538291 tst mo_mt_call.py: using CellId 38741 05:31:44.658817 tst mo_mt_call.py: using BVCI 38742 05:31:44.769477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:44.780463 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:44.791178 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:44.801923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:44.813308 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:44.825201 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:44.946224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:45.063602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:45.535097 run create_hlr_db(pid=12135): Launched 05:31:45.651640 bus /sierra_2: Setting Powered False 05:31:46.724006 run create_hlr_db(pid=12135): Terminated: ok {rc=0} 05:31:47.206889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12137): Launched 05:31:47.518165 run osmo-hlr_10.42.42.2(pid=12138): Launched 05:31:47.634318 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:48.167188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12140): Launched 05:31:48.473680 run osmo-stp_10.42.42.5(pid=12141): Launched 05:31:48.598999 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:49.190107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12143): Launched 05:31:49.515364 run osmo-msc_10.42.42.6(pid=12144): Launched 05:31:49.689505 run osmo-stp_10.42.42.5(pid=12141): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12141)] 05:31:49.819324 run osmo-stp_10.42.42.5(pid=12141): stdout: | (launched: 2022-12-14_05:31:48.415405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:49.949148 run osmo-stp_10.42.42.5(pid=12141): stderr: | 20221214053148606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053148606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053148606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053148607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053148607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053148607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053148607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:50.075989 run osmo-stp_10.42.42.5(pid=12141): stdout: | (launched: 2022-12-14_05:31:48.415405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:50.197761 run osmo-stp_10.42.42.5(pid=12141): stderr: | 20221214053148606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053148606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053148606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053148607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053148607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053148607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053148607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:50.342785 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12141): Process ended prematurely: osmo-stp_10.42.42.5(pid=12141) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12141)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:31:50.351712 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:31:50.377836 run osmo-hlr_10.42.42.2(pid=12138): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12138)] 05:31:50.425860 run osmo-hlr_10.42.42.2(pid=12138): stdout: | (launched: 2022-12-14_05:31:47.462583) 05:31:50.475065 run osmo-hlr_10.42.42.2(pid=12138): stderr: | 20221214053147636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053147636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053147636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053147636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053147636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053147636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053147648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053147657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053147657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053147658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:50.543831 run osmo-msc_10.42.42.6(pid=12144): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12144)] 05:31:50.591250 run osmo-msc_10.42.42.6(pid=12144): stdout: | (launched: 2022-12-14_05:31:49.456404) 05:31:50.640528 run osmo-msc_10.42.42.6(pid=12144): stderr: | 20221214053149729 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053149729 DLGLOBAL DEBUG validating counter group 0x7f8244269c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053149729 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053149730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053149730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053149730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053149732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053149732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053149732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053149732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:50.689987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12137): Terminating (SIGTERM) 05:31:50.729594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12140): Terminating (SIGTERM) 05:31:50.769064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12143): Terminating (SIGTERM) 05:31:50.808617 --- ParallelTerminationStrategy: PID 12137 died... 05:31:50.828101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12137): Terminated: ok {rc=0} 05:31:50.871961 --- ParallelTerminationStrategy: PID 12140 died... 05:31:50.890817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12140): Terminated: ok {rc=0} 05:31:50.935095 --- ParallelTerminationStrategy: PID 12143 died... 05:31:50.954262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12143): Terminated: ok {rc=0} 05:31:51.038154 bus /sierra_3: Setting Powered False 05:31:52.136047 bus /sierra_3: Setting Powered False 05:31:53.251556 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:31:54.400765 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:54.412848 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:31:54.470024 tst mo_mt_call_osmux.py: using LAC 38742 05:31:54.597670 tst mo_mt_call_osmux.py: using RAC 237 05:31:54.718202 tst mo_mt_call_osmux.py: using CellId 38742 05:31:54.837129 tst mo_mt_call_osmux.py: using BVCI 38743 05:31:54.947625 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:54.959035 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:54.969940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:54.980749 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:54.992705 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:55.004509 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:55.124398 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:55.241590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:55.712905 run create_hlr_db(pid=12146): Launched 05:31:55.830019 bus /sierra_2: Setting Powered False 05:31:56.890253 run create_hlr_db(pid=12146): Terminated: ok {rc=0} 05:31:57.314234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12148): Launched 05:31:57.619156 run osmo-hlr_10.42.42.2(pid=12149): Launched 05:31:57.735087 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:58.270371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12151): Launched 05:31:58.574744 run osmo-stp_10.42.42.5(pid=12152): Launched 05:31:58.690834 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:59.241317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12154): Launched 05:31:59.545160 run osmo-msc_10.42.42.6(pid=12155): Launched 05:31:59.714845 run osmo-stp_10.42.42.5(pid=12152): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12152)] 05:31:59.844068 run osmo-stp_10.42.42.5(pid=12152): stdout: | (launched: 2022-12-14_05:31:58.518899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:59.972585 run osmo-stp_10.42.42.5(pid=12152): stderr: | 20221214053158687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053158687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053158687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053158688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053158688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053158688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053158688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:00.098832 run osmo-stp_10.42.42.5(pid=12152): stdout: | (launched: 2022-12-14_05:31:58.518899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:00.219830 run osmo-stp_10.42.42.5(pid=12152): stderr: | 20221214053158687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053158687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053158687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053158688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053158688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053158688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053158688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:00.364138 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12152): Process ended prematurely: osmo-stp_10.42.42.5(pid=12152) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12152)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:32:00.372942 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 05:32:00.398734 run osmo-hlr_10.42.42.2(pid=12149): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12149)] 05:32:00.446495 run osmo-hlr_10.42.42.2(pid=12149): stdout: | (launched: 2022-12-14_05:31:57.563640) 05:32:00.495202 run osmo-hlr_10.42.42.2(pid=12149): stderr: | 20221214053157736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053157736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053157736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053157736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053157736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053157737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053157748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053157756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053157756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053157756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:00.563312 run osmo-msc_10.42.42.6(pid=12155): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12155)] 05:32:00.610063 run osmo-msc_10.42.42.6(pid=12155): stdout: | (launched: 2022-12-14_05:31:59.489480) 05:32:00.658910 run osmo-msc_10.42.42.6(pid=12155): stderr: | 20221214053159758 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053159758 DLGLOBAL DEBUG validating counter group 0x7f6aa4f72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053159758 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053159759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053159759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053159759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053159761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053159761 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053159761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053159761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:00.707960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12148): Terminating (SIGTERM) 05:32:00.747288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12151): Terminating (SIGTERM) 05:32:00.786656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12154): Terminating (SIGTERM) 05:32:00.826411 --- ParallelTerminationStrategy: PID 12148 died... 05:32:00.854179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12148): Terminated: ok {rc=0} 05:32:00.930188 --- ParallelTerminationStrategy: PID 12151 died... 05:32:00.952161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12151): Terminated: ok {rc=0} 05:32:01.015845 --- ParallelTerminationStrategy: PID 12154 died... 05:32:01.038959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12154): Terminated: ok {rc=0} 05:32:01.131134 bus /sierra_3: Setting Powered False 05:32:02.236448 bus /sierra_3: Setting Powered False 05:32:03.350588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:32:04.580419 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:04.587073 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:32:04.607267 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:32:04.633895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:32:04.685013 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:32:04.706468 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:32:04.733713 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:32:05.281884 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:32:05.331833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:05.342751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:32:05.402362 tst mo_mt_call.py: using LAC 38743 05:32:05.521169 tst mo_mt_call.py: using RAC 238 05:32:05.637979 tst mo_mt_call.py: using CellId 38743 05:32:05.754780 tst mo_mt_call.py: using BVCI 38744 05:32:05.865139 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:05.876248 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:05.886968 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:05.897639 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:05.908705 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:05.920197 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:32:06.041192 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:32:06.156099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:06.629642 run create_hlr_db(pid=12160): Launched 05:32:06.746041 bus /sierra_2: Setting Powered False 05:32:07.806675 run create_hlr_db(pid=12160): Terminated: ok {rc=0} 05:32:08.252837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12162): Launched 05:32:08.580399 run osmo-hlr_10.42.42.2(pid=12163): Launched 05:32:08.705125 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:09.267237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12165): Launched 05:32:09.593195 run osmo-stp_10.42.42.5(pid=12166): Launched 05:32:09.717483 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:10.308218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12168): Launched 05:32:10.634763 run osmo-msc_10.42.42.6(pid=12169): Launched 05:32:10.815636 run osmo-stp_10.42.42.5(pid=12166): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12166)] 05:32:10.952810 run osmo-stp_10.42.42.5(pid=12166): stdout: | (launched: 2022-12-14_05:32:09.534196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:11.090566 run osmo-stp_10.42.42.5(pid=12166): stderr: | 20221214053209723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053209723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053209723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053209723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053209724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053209724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053209724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:11.226500 run osmo-stp_10.42.42.5(pid=12166): stdout: | (launched: 2022-12-14_05:32:09.534196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:11.356163 run osmo-stp_10.42.42.5(pid=12166): stderr: | 20221214053209723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053209723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053209723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053209723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053209724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053209724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053209724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:11.511447 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12166): Process ended prematurely: osmo-stp_10.42.42.5(pid=12166) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12166)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:32:11.520648 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:32:11.548538 run osmo-hlr_10.42.42.2(pid=12163): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12163)] 05:32:11.598681 run osmo-hlr_10.42.42.2(pid=12163): stdout: | (launched: 2022-12-14_05:32:08.521252) 05:32:11.650348 run osmo-hlr_10.42.42.2(pid=12163): stderr: | 20221214053208715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053208715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053208715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053208715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053208715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053208715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053208728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053208738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053208738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053208738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:11.722564 run osmo-msc_10.42.42.6(pid=12169): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12169)] 05:32:11.772405 run osmo-msc_10.42.42.6(pid=12169): stdout: | (launched: 2022-12-14_05:32:10.575400) 05:32:11.823957 run osmo-msc_10.42.42.6(pid=12169): stderr: | 20221214053210895 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053210895 DLGLOBAL DEBUG validating counter group 0x7ff8b37e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053210895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053210895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053210895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053210896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053210897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053210898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053210898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053210898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:11.876434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12162): Terminating (SIGTERM) 05:32:11.918397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12165): Terminating (SIGTERM) 05:32:11.959962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12168): Terminating (SIGTERM) 05:32:12.002112 --- ParallelTerminationStrategy: PID 12162 died... 05:32:12.021956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12162): Terminated: ok {rc=0} 05:32:12.068021 --- ParallelTerminationStrategy: PID 12165 died... 05:32:12.087466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12165): Terminated: ok {rc=0} 05:32:12.133213 --- ParallelTerminationStrategy: PID 12168 died... 05:32:12.152754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12168): Terminated: ok {rc=0} 05:32:12.241321 bus /sierra_3: Setting Powered False 05:32:13.340165 bus /sierra_3: Setting Powered False 05:32:14.456295 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:32:15.605611 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:15.617625 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:32:15.673588 tst mo_mt_call_osmux.py: using LAC 38744 05:32:15.799680 tst mo_mt_call_osmux.py: using RAC 239 05:32:15.946631 tst mo_mt_call_osmux.py: using CellId 38744 05:32:16.068371 tst mo_mt_call_osmux.py: using BVCI 38745 05:32:16.190555 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:16.202734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:16.214760 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:16.226689 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:16.238579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:32:16.250677 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:32:16.397771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:32:16.527185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:17.049440 run create_hlr_db(pid=12171): Launched 05:32:17.214007 bus /sierra_2: Setting Powered False 05:32:18.278463 run create_hlr_db(pid=12171): Terminated: ok {rc=0} 05:32:18.730698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12173): Launched 05:32:19.057663 run osmo-hlr_10.42.42.2(pid=12174): Launched 05:32:19.180795 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:19.753184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12176): Launched 05:32:20.079718 run osmo-stp_10.42.42.5(pid=12177): Launched 05:32:20.202591 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:20.798105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12179): Launched 05:32:21.124664 run osmo-msc_10.42.42.6(pid=12180): Launched 05:32:21.304893 run osmo-stp_10.42.42.5(pid=12177): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12177)] 05:32:21.441892 run osmo-stp_10.42.42.5(pid=12177): stdout: | (launched: 2022-12-14_05:32:20.020671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:21.579598 run osmo-stp_10.42.42.5(pid=12177): stderr: | 20221214053220210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053220211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053220211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053220211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053220212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053220212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053220212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:21.715678 run osmo-stp_10.42.42.5(pid=12177): stdout: | (launched: 2022-12-14_05:32:20.020671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:21.845370 run osmo-stp_10.42.42.5(pid=12177): stderr: | 20221214053220210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053220211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053220211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053220211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053220212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053220212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053220212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:22.001944 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12177): Process ended prematurely: osmo-stp_10.42.42.5(pid=12177) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12177)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:32:22.011678 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:32:22.039211 run osmo-hlr_10.42.42.2(pid=12174): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12174)] 05:32:22.089237 run osmo-hlr_10.42.42.2(pid=12174): stdout: | (launched: 2022-12-14_05:32:18.998621) 05:32:22.140587 run osmo-hlr_10.42.42.2(pid=12174): stderr: | 20221214053219193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053219193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053219193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053219193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053219193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053219194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053219207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053219215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053219215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053219215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:22.212200 run osmo-msc_10.42.42.6(pid=12180): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12180)] 05:32:22.261760 run osmo-msc_10.42.42.6(pid=12180): stdout: | (launched: 2022-12-14_05:32:21.065695) 05:32:22.312879 run osmo-msc_10.42.42.6(pid=12180): stderr: | 20221214053221386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053221386 DLGLOBAL DEBUG validating counter group 0x7f22d8e83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053221387 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053221387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053221387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053221387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053221389 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053221389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053221389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053221389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:22.364456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12173): Terminating (SIGTERM) 05:32:22.405756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12176): Terminating (SIGTERM) 05:32:22.447012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12179): Terminating (SIGTERM) 05:32:22.488543 --- ParallelTerminationStrategy: PID 12173 died... 05:32:22.508404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12173): Terminated: ok {rc=0} 05:32:22.554073 --- ParallelTerminationStrategy: PID 12176 died... 05:32:22.573556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12176): Terminated: ok {rc=0} 05:32:22.619072 --- ParallelTerminationStrategy: PID 12179 died... 05:32:22.638543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12179): Terminated: ok {rc=0} 05:32:22.724353 bus /sierra_3: Setting Powered False 05:32:23.821254 bus /sierra_3: Setting Powered False 05:32:24.932081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:32:26.169611 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:26.176521 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:32:26.197637 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:32:26.225083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:32:26.276642 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:32:26.297871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:32:26.324741 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:32:26.878411 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:32:26.931417 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:26.942911 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:32:26.999842 tst mo_mt_call.py: using LAC 38745 05:32:27.129369 tst mo_mt_call.py: using RAC 240 05:32:27.257487 tst mo_mt_call.py: using CellId 38745 05:32:27.384689 tst mo_mt_call.py: using BVCI 38746 05:32:27.503271 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:27.514748 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:27.526016 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:27.537166 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:27.548461 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:27.559966 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:27.678610 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:27.797531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:28.303656 run create_hlr_db(pid=12185): Launched 05:32:28.435867 bus /sierra_2: Setting Powered False 05:32:29.500600 run create_hlr_db(pid=12185): Terminated: ok {rc=0} 05:32:29.936146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Launched 05:32:30.241283 run osmo-hlr_10.42.42.2(pid=12188): Launched 05:32:30.358000 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:30.893132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Launched 05:32:31.234135 run osmo-stp_10.42.42.5(pid=12191): Launched 05:32:31.437676 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:32.245658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12193): Launched 05:32:32.558840 run osmo-msc_10.42.42.6(pid=12194): Launched 05:32:32.730088 run osmo-stp_10.42.42.5(pid=12191): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] 05:32:32.860346 run osmo-stp_10.42.42.5(pid=12191): stdout: | (launched: 2022-12-14_05:32:31.177722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:32.990014 run osmo-stp_10.42.42.5(pid=12191): stderr: | 20221214053231494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053231494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053231495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053231497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053231498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053231499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053231499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:33.117540 run osmo-stp_10.42.42.5(pid=12191): stdout: | (launched: 2022-12-14_05:32:31.177722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:33.239015 run osmo-stp_10.42.42.5(pid=12191): stderr: | 20221214053231494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053231494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053231495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053231497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053231498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053231499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053231499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:33.384481 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12191): Process ended prematurely: osmo-stp_10.42.42.5(pid=12191) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:32:33.393282 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:32:33.418914 run osmo-hlr_10.42.42.2(pid=12188): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12188)] 05:32:33.466993 run osmo-hlr_10.42.42.2(pid=12188): stdout: | (launched: 2022-12-14_05:32:30.185763) 05:32:33.516033 run osmo-hlr_10.42.42.2(pid=12188): stderr: | 20221214053230360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053230360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053230360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053230360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053230360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053230360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053230372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053230380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053230381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053230381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:33.585256 run osmo-msc_10.42.42.6(pid=12194): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12194)] 05:32:33.631812 run osmo-msc_10.42.42.6(pid=12194): stdout: | (launched: 2022-12-14_05:32:32.503143) 05:32:33.681083 run osmo-msc_10.42.42.6(pid=12194): stderr: | 20221214053232770 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053232771 DLGLOBAL DEBUG validating counter group 0x7f4f3366fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053232771 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053232771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053232771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053232771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053232773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053232773 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053232774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053232774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:33.730694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Terminating (SIGTERM) 05:32:33.770333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Terminating (SIGTERM) 05:32:33.809988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12193): Terminating (SIGTERM) 05:32:33.849941 --- ParallelTerminationStrategy: PID 12187 died... 05:32:33.869459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Terminated: ok {rc=0} 05:32:33.913243 --- ParallelTerminationStrategy: PID 12190 died... 05:32:33.932336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Terminated: ok {rc=0} 05:32:33.976401 --- ParallelTerminationStrategy: PID 12193 died... 05:32:33.995633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12193): Terminated: ok {rc=0} 05:32:34.082781 bus /sierra_3: Setting Powered False 05:32:35.181244 bus /sierra_3: Setting Powered False 05:32:36.294780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:32:37.440274 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:37.451785 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:32:37.509106 tst mo_mt_call_osmux.py: using LAC 38746 05:32:37.629750 tst mo_mt_call_osmux.py: using RAC 241 05:32:37.748695 tst mo_mt_call_osmux.py: using CellId 38746 05:32:37.867540 tst mo_mt_call_osmux.py: using BVCI 38747 05:32:37.979660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:37.990630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:38.001377 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:38.011982 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:38.023028 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:38.034134 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:38.151485 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:38.270838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:38.777503 run create_hlr_db(pid=12196): Launched 05:32:38.910775 bus /sierra_2: Setting Powered False 05:32:39.975175 run create_hlr_db(pid=12196): Terminated: ok {rc=0} 05:32:40.430052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Launched 05:32:40.756811 run osmo-hlr_10.42.42.2(pid=12199): Launched 05:32:40.881981 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:41.444486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Launched 05:32:41.771552 run osmo-stp_10.42.42.5(pid=12202): Launched 05:32:41.895492 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:42.485722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12204): Launched 05:32:42.811580 run osmo-msc_10.42.42.6(pid=12205): Launched 05:32:42.993099 run osmo-stp_10.42.42.5(pid=12202): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] 05:32:43.130125 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-14_05:32:41.712512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:43.267882 run osmo-stp_10.42.42.5(pid=12202): stderr: | 20221214053241903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053241903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053241904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053241904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053241904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053241905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053241905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:43.404511 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-14_05:32:41.712512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:43.534597 run osmo-stp_10.42.42.5(pid=12202): stderr: | 20221214053241903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053241903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053241904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053241904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053241904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053241905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053241905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:43.690255 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:32:43.699729 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:32:43.727246 run osmo-hlr_10.42.42.2(pid=12199): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12199)] 05:32:43.777279 run osmo-hlr_10.42.42.2(pid=12199): stdout: | (launched: 2022-12-14_05:32:40.697644) 05:32:43.829193 run osmo-hlr_10.42.42.2(pid=12199): stderr: | 20221214053240893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053240893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053240894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053240894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053240894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053240894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053240904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053240914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053240914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053240914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:43.901534 run osmo-msc_10.42.42.6(pid=12205): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12205)] 05:32:43.951903 run osmo-msc_10.42.42.6(pid=12205): stdout: | (launched: 2022-12-14_05:32:42.752390) 05:32:44.003854 run osmo-msc_10.42.42.6(pid=12205): stderr: | 20221214053243074 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053243074 DLGLOBAL DEBUG validating counter group 0x7fa39012fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053243075 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053243075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053243075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053243075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053243077 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053243077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053243077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053243077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:44.055801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminating (SIGTERM) 05:32:44.097481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminating (SIGTERM) 05:32:44.140120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12204): Terminating (SIGTERM) 05:32:44.182672 --- ParallelTerminationStrategy: PID 12198 died... 05:32:44.202757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminated: ok {rc=0} 05:32:44.248788 --- ParallelTerminationStrategy: PID 12201 died... 05:32:44.268831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminated: ok {rc=0} 05:32:44.314882 --- ParallelTerminationStrategy: PID 12204 died... 05:32:44.334484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12204): Terminated: ok {rc=0} 05:32:44.422629 bus /sierra_3: Setting Powered False 05:32:45.517589 bus /sierra_3: Setting Powered False 05:32:46.637055 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:32:47.880476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:47.886923 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:32:47.907196 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:32:47.934840 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:32:47.983697 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:32:48.004292 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:32:48.031029 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:32:48.586159 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:32:48.637555 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:48.648580 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:32:48.702879 tst mo_mt_call.py: using LAC 38747 05:32:48.821801 tst mo_mt_call.py: using RAC 242 05:32:48.941790 tst mo_mt_call.py: using CellId 38747 05:32:49.061638 tst mo_mt_call.py: using BVCI 38748 05:32:49.174211 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:49.185397 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:49.196092 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:49.206828 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:49.218083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:49.229559 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:49.349275 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:49.466381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:49.939637 run create_hlr_db(pid=12210): Launched 05:32:50.055520 bus /sierra_2: Setting Powered False 05:32:51.115795 run create_hlr_db(pid=12210): Terminated: ok {rc=0} 05:32:51.562319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12212): Launched 05:32:51.888558 run osmo-hlr_10.42.42.2(pid=12213): Launched 05:32:52.013499 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:52.579841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12215): Launched 05:32:52.905661 run osmo-stp_10.42.42.5(pid=12216): Launched 05:32:53.029981 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:53.618344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12218): Launched 05:32:53.944635 run osmo-msc_10.42.42.6(pid=12219): Launched 05:32:54.126078 run osmo-stp_10.42.42.5(pid=12216): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12216)] 05:32:54.263661 run osmo-stp_10.42.42.5(pid=12216): stdout: | (launched: 2022-12-14_05:32:52.846741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:54.401424 run osmo-stp_10.42.42.5(pid=12216): stderr: | 20221214053253034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053253035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053253035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053253035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053253036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053253036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053253036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:54.537337 run osmo-stp_10.42.42.5(pid=12216): stdout: | (launched: 2022-12-14_05:32:52.846741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:54.666717 run osmo-stp_10.42.42.5(pid=12216): stderr: | 20221214053253034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053253035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053253035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053253035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053253036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053253036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053253036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:54.821809 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12216): Process ended prematurely: osmo-stp_10.42.42.5(pid=12216) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12216)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:32:54.831340 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:32:54.858752 run osmo-hlr_10.42.42.2(pid=12213): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12213)] 05:32:54.908438 run osmo-hlr_10.42.42.2(pid=12213): stdout: | (launched: 2022-12-14_05:32:51.829522) 05:32:54.960262 run osmo-hlr_10.42.42.2(pid=12213): stderr: | 20221214053252027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053252027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053252027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053252027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053252027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053252027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053252040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053252048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053252048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053252048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:55.031676 run osmo-msc_10.42.42.6(pid=12219): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12219)] 05:32:55.081143 run osmo-msc_10.42.42.6(pid=12219): stdout: | (launched: 2022-12-14_05:32:53.885372) 05:32:55.132340 run osmo-msc_10.42.42.6(pid=12219): stderr: | 20221214053254207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053254207 DLGLOBAL DEBUG validating counter group 0x7ffb48f1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053254207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053254207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053254207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053254208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053254209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053254210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053254210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053254210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:55.183848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12212): Terminating (SIGTERM) 05:32:55.225076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12215): Terminating (SIGTERM) 05:32:55.266397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12218): Terminating (SIGTERM) 05:32:55.308036 --- ParallelTerminationStrategy: PID 12212 died... 05:32:55.327755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12212): Terminated: ok {rc=0} 05:32:55.373677 --- ParallelTerminationStrategy: PID 12215 died... 05:32:55.393197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12215): Terminated: ok {rc=0} 05:32:55.439204 --- ParallelTerminationStrategy: PID 12218 died... 05:32:55.458772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12218): Terminated: ok {rc=0} 05:32:55.545407 bus /sierra_3: Setting Powered False 05:32:56.643197 bus /sierra_3: Setting Powered False 05:32:57.756067 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:32:58.904863 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:58.917136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:32:58.975703 tst mo_mt_call_osmux.py: using LAC 38748 05:32:59.104715 tst mo_mt_call_osmux.py: using RAC 243 05:32:59.232322 tst mo_mt_call_osmux.py: using CellId 38748 05:32:59.360113 tst mo_mt_call_osmux.py: using BVCI 38749 05:32:59.471539 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:59.483040 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:59.493996 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:59.504631 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:59.515551 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:59.526914 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:59.642135 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:59.763735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:00.269233 run create_hlr_db(pid=12221): Launched 05:33:00.401817 bus /sierra_2: Setting Powered False 05:33:01.487780 run create_hlr_db(pid=12221): Terminated: ok {rc=0} 05:33:01.954536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12224): Launched 05:33:02.288843 run osmo-hlr_10.42.42.2(pid=12225): Launched 05:33:02.406388 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:02.928663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12227): Launched 05:33:03.232472 run osmo-stp_10.42.42.5(pid=12228): Launched 05:33:03.348829 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:03.897457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12230): Launched 05:33:04.202046 run osmo-msc_10.42.42.6(pid=12231): Launched 05:33:04.372834 run osmo-stp_10.42.42.5(pid=12228): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12228)] 05:33:04.501920 run osmo-stp_10.42.42.5(pid=12228): stdout: | (launched: 2022-12-14_05:33:03.177182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:04.630873 run osmo-stp_10.42.42.5(pid=12228): stderr: | 20221214053303344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053303344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053303345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053303345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053303346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053303346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053303346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:04.757755 run osmo-stp_10.42.42.5(pid=12228): stdout: | (launched: 2022-12-14_05:33:03.177182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:04.879247 run osmo-stp_10.42.42.5(pid=12228): stderr: | 20221214053303344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053303344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053303345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053303345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053303346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053303346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053303346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:05.024575 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12228): Process ended prematurely: osmo-stp_10.42.42.5(pid=12228) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12228)] [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:33:05.033819 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:33:05.059763 run osmo-hlr_10.42.42.2(pid=12225): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12225)] 05:33:05.107538 run osmo-hlr_10.42.42.2(pid=12225): stdout: | (launched: 2022-12-14_05:33:02.231982) 05:33:05.156353 run osmo-hlr_10.42.42.2(pid=12225): stderr: | 20221214053302405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053302405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053302405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053302405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053302405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053302405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053302450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053302458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053302459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053302459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:05.225190 run osmo-msc_10.42.42.6(pid=12231): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12231)] 05:33:05.272055 run osmo-msc_10.42.42.6(pid=12231): stdout: | (launched: 2022-12-14_05:33:04.146656) 05:33:05.321283 run osmo-msc_10.42.42.6(pid=12231): stderr: | 20221214053304417 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053304417 DLGLOBAL DEBUG validating counter group 0x7f746f131c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053304417 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053304417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053304417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053304417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053304419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053304419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053304420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053304420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:05.370554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12224): Terminating (SIGTERM) 05:33:05.410050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12227): Terminating (SIGTERM) 05:33:05.449543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12230): Terminating (SIGTERM) 05:33:05.489317 --- ParallelTerminationStrategy: PID 12224 died... 05:33:05.508284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12224): Terminated: ok {rc=0} 05:33:05.551618 --- ParallelTerminationStrategy: PID 12227 died... 05:33:05.570239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12227): Terminated: ok {rc=0} 05:33:05.614048 --- ParallelTerminationStrategy: PID 12230 died... 05:33:05.632552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12230): Terminated: ok {rc=0} 05:33:05.717072 bus /sierra_3: Setting Powered False 05:33:06.814444 bus /sierra_3: Setting Powered False 05:33:07.925461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:33:09.160731 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:09.167645 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:33:09.188639 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:33:09.216559 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:33:09.269117 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:33:09.289369 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:33:09.315124 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:33:09.869469 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:33:09.922128 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:09.934134 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:33:09.992714 tst mo_mt_call.py: using LAC 38749 05:33:10.121256 tst mo_mt_call.py: using RAC 244 05:33:10.252872 tst mo_mt_call.py: using CellId 38749 05:33:10.380391 tst mo_mt_call.py: using BVCI 38750 05:33:10.498228 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:10.509666 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:10.520740 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:10.532095 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:10.543252 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:10.554576 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:33:10.673071 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:33:10.789790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:11.263100 run create_hlr_db(pid=12236): Launched 05:33:11.380419 bus /sierra_2: Setting Powered False 05:33:12.441737 run create_hlr_db(pid=12236): Terminated: ok {rc=0} 05:33:12.889998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12238): Launched 05:33:13.217666 run osmo-hlr_10.42.42.2(pid=12239): Launched 05:33:13.341538 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:13.904330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12241): Launched 05:33:14.230947 run osmo-stp_10.42.42.5(pid=12242): Launched 05:33:14.355389 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:14.945534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12244): Launched 05:33:15.271990 run osmo-msc_10.42.42.6(pid=12245): Launched 05:33:15.453693 run osmo-stp_10.42.42.5(pid=12242): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12242)] 05:33:15.590431 run osmo-stp_10.42.42.5(pid=12242): stdout: | (launched: 2022-12-14_05:33:14.171740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:15.727574 run osmo-stp_10.42.42.5(pid=12242): stderr: | 20221214053314362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053314362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053314362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053314363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053314363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053314363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053314363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:15.887802 run osmo-stp_10.42.42.5(pid=12242): stdout: | (launched: 2022-12-14_05:33:14.171740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:16.020831 run osmo-stp_10.42.42.5(pid=12242): stderr: | 20221214053314362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053314362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053314362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053314363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053314363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053314363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053314363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:16.176138 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12242): Process ended prematurely: osmo-stp_10.42.42.5(pid=12242) [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12242)] [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:33:16.186247 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:33:16.213850 run osmo-hlr_10.42.42.2(pid=12239): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12239)] 05:33:16.265344 run osmo-hlr_10.42.42.2(pid=12239): stdout: | (launched: 2022-12-14_05:33:13.158644) 05:33:16.319738 run osmo-hlr_10.42.42.2(pid=12239): stderr: | 20221214053313355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053313355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053313355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053313355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053313355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053313355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053313368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053313376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053313376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053313376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:16.392761 run osmo-msc_10.42.42.6(pid=12245): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12245)] 05:33:16.441716 run osmo-msc_10.42.42.6(pid=12245): stdout: | (launched: 2022-12-14_05:33:15.212888) 05:33:16.494671 run osmo-msc_10.42.42.6(pid=12245): stderr: | 20221214053315535 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053315535 DLGLOBAL DEBUG validating counter group 0x7feabb56ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053315535 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053315535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053315535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053315535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053315537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053315537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053315538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053315538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:16.546909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12238): Terminating (SIGTERM) 05:33:16.589891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12241): Terminating (SIGTERM) 05:33:16.634657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12244): Terminating (SIGTERM) 05:33:16.680039 --- ParallelTerminationStrategy: PID 12238 died... 05:33:16.702245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12238): Terminated: ok {rc=0} 05:33:16.751563 --- ParallelTerminationStrategy: PID 12241 died... 05:33:16.772311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12241): Terminated: ok {rc=0} 05:33:16.819481 --- ParallelTerminationStrategy: PID 12244 died... 05:33:16.840318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12244): Terminated: ok {rc=0} 05:33:16.932188 bus /sierra_3: Setting Powered False 05:33:18.037707 bus /sierra_3: Setting Powered False 05:33:19.151542 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:33:20.296445 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:20.308228 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:33:20.365356 tst mo_mt_call_osmux.py: using LAC 38750 05:33:20.486409 tst mo_mt_call_osmux.py: using RAC 245 05:33:20.607709 tst mo_mt_call_osmux.py: using CellId 38750 05:33:20.729244 tst mo_mt_call_osmux.py: using BVCI 38751 05:33:20.841196 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:20.852251 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:20.863128 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:20.873980 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:20.885155 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:33:20.896385 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:33:21.011991 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:33:21.132540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:21.638937 run create_hlr_db(pid=12247): Launched 05:33:21.771765 bus /sierra_2: Setting Powered False 05:33:22.836797 run create_hlr_db(pid=12247): Terminated: ok {rc=0} 05:33:23.273995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12249): Launched 05:33:23.581160 run osmo-hlr_10.42.42.2(pid=12250): Launched 05:33:23.697535 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:24.227505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12252): Launched 05:33:24.533887 run osmo-stp_10.42.42.5(pid=12253): Launched 05:33:24.650965 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:25.202688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12255): Launched 05:33:25.508213 run osmo-msc_10.42.42.6(pid=12256): Launched 05:33:25.679105 run osmo-stp_10.42.42.5(pid=12253): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12253)] 05:33:25.808397 run osmo-stp_10.42.42.5(pid=12253): stdout: | (launched: 2022-12-14_05:33:24.478011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:25.937671 run osmo-stp_10.42.42.5(pid=12253): stderr: | 20221214053324644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053324644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053324644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053324644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053324645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053324645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053324645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:26.064907 run osmo-stp_10.42.42.5(pid=12253): stdout: | (launched: 2022-12-14_05:33:24.478011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:26.186261 run osmo-stp_10.42.42.5(pid=12253): stderr: | 20221214053324644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053324644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053324644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053324644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053324645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053324645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053324645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:26.331857 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12253): Process ended prematurely: osmo-stp_10.42.42.5(pid=12253) [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12253)] [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:33:26.340918 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:33:26.367205 run osmo-hlr_10.42.42.2(pid=12250): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12250)] 05:33:26.415202 run osmo-hlr_10.42.42.2(pid=12250): stdout: | (launched: 2022-12-14_05:33:23.525335) 05:33:26.465289 run osmo-hlr_10.42.42.2(pid=12250): stderr: | 20221214053323699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053323699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053323699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053323699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053323699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053323699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053323712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053323720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053323720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053323720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:26.534670 run osmo-msc_10.42.42.6(pid=12256): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12256)] 05:33:26.581908 run osmo-msc_10.42.42.6(pid=12256): stdout: | (launched: 2022-12-14_05:33:25.452322) 05:33:26.631311 run osmo-msc_10.42.42.6(pid=12256): stderr: | 20221214053325723 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053325723 DLGLOBAL DEBUG validating counter group 0x7f9eed235c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053325723 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053325723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053325723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053325723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053325725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053325726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053325726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053325726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:26.680916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12249): Terminating (SIGTERM) 05:33:26.720826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12252): Terminating (SIGTERM) 05:33:26.760531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12255): Terminating (SIGTERM) 05:33:26.800391 --- ParallelTerminationStrategy: PID 12249 died... 05:33:26.819952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12249): Terminated: ok {rc=0} 05:33:26.864082 --- ParallelTerminationStrategy: PID 12252 died... 05:33:26.883125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12252): Terminated: ok {rc=0} 05:33:26.926870 --- ParallelTerminationStrategy: PID 12255 died... 05:33:26.945917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12255): Terminated: ok {rc=0} 05:33:27.031965 bus /sierra_3: Setting Powered False 05:33:28.130516 bus /sierra_3: Setting Powered False 05:33:29.242373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:33:30.474203 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:30.479648 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:33:30.500130 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:33:30.527884 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:33:30.579567 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:33:30.601092 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:33:30.628715 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:33:31.203335 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:33:31.260593 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:31.272830 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:33:31.334664 tst mo_mt_call.py: using LAC 38751 05:33:31.486273 tst mo_mt_call.py: using RAC 246 05:33:31.617662 tst mo_mt_call.py: using CellId 38751 05:33:31.740106 tst mo_mt_call.py: using BVCI 38752 05:33:31.855123 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:31.866850 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:31.878606 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:31.898281 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:31.915159 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:31.927771 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:32.045885 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:32.168298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:32.646032 run create_hlr_db(pid=12261): Launched 05:33:32.763134 bus /sierra_2: Setting Powered False 05:33:33.823697 run create_hlr_db(pid=12261): Terminated: ok {rc=0} 05:33:34.269351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12263): Launched 05:33:34.595967 run osmo-hlr_10.42.42.2(pid=12264): Launched 05:33:34.719790 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:35.282780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12266): Launched 05:33:35.609672 run osmo-stp_10.42.42.5(pid=12267): Launched 05:33:35.734929 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:36.325528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12269): Launched 05:33:36.652161 run osmo-msc_10.42.42.6(pid=12270): Launched 05:33:36.833204 run osmo-stp_10.42.42.5(pid=12267): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12267)] 05:33:36.971013 run osmo-stp_10.42.42.5(pid=12267): stdout: | (launched: 2022-12-14_05:33:35.550272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:37.109128 run osmo-stp_10.42.42.5(pid=12267): stderr: | 20221214053335739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053335739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053335739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053335739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053335740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053335740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053335740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:37.246107 run osmo-stp_10.42.42.5(pid=12267): stdout: | (launched: 2022-12-14_05:33:35.550272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:37.376002 run osmo-stp_10.42.42.5(pid=12267): stderr: | 20221214053335739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053335739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053335739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053335739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053335740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053335740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053335740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:37.531379 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12267): Process ended prematurely: osmo-stp_10.42.42.5(pid=12267) [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12267)] [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:33:37.540659 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:33:37.568094 run osmo-hlr_10.42.42.2(pid=12264): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12264)] 05:33:37.617883 run osmo-hlr_10.42.42.2(pid=12264): stdout: | (launched: 2022-12-14_05:33:34.536602) 05:33:37.669487 run osmo-hlr_10.42.42.2(pid=12264): stderr: | 20221214053334734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053334734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053334734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053334734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053334734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053334734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053334747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053334755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053334755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053334755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:37.741665 run osmo-msc_10.42.42.6(pid=12270): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12270)] 05:33:37.791722 run osmo-msc_10.42.42.6(pid=12270): stdout: | (launched: 2022-12-14_05:33:36.593102) 05:33:37.843601 run osmo-msc_10.42.42.6(pid=12270): stderr: | 20221214053336914 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053336915 DLGLOBAL DEBUG validating counter group 0x7f219c66dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053336915 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053336915 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053336915 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053336915 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053336917 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053336917 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053336917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053336917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:37.895545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12263): Terminating (SIGTERM) 05:33:37.937368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12266): Terminating (SIGTERM) 05:33:37.979514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12269): Terminating (SIGTERM) 05:33:38.021831 --- ParallelTerminationStrategy: PID 12263 died... 05:33:38.041881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12263): Terminated: ok {rc=0} 05:33:38.088013 --- ParallelTerminationStrategy: PID 12266 died... 05:33:38.107522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12266): Terminated: ok {rc=0} 05:33:38.153603 --- ParallelTerminationStrategy: PID 12269 died... 05:33:38.173080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12269): Terminated: ok {rc=0} 05:33:38.260482 bus /sierra_3: Setting Powered False 05:33:39.358370 bus /sierra_3: Setting Powered False 05:33:40.472846 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:33:41.619110 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:41.630638 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:33:41.687433 tst mo_mt_call_osmux.py: using LAC 38752 05:33:41.808224 tst mo_mt_call_osmux.py: using RAC 247 05:33:41.929473 tst mo_mt_call_osmux.py: using CellId 38752 05:33:42.050648 tst mo_mt_call_osmux.py: using BVCI 38753 05:33:42.162382 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:42.173217 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:42.183747 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:42.194211 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:42.204630 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:42.216669 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:42.332328 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:42.452395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:42.958597 run create_hlr_db(pid=12272): Launched 05:33:43.090962 bus /sierra_2: Setting Powered False 05:33:44.154556 run create_hlr_db(pid=12272): Terminated: ok {rc=0} 05:33:44.590044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12274): Launched 05:33:44.894934 run osmo-hlr_10.42.42.2(pid=12275): Launched 05:33:45.010404 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:45.534704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12277): Launched 05:33:45.849937 run osmo-stp_10.42.42.5(pid=12278): Launched 05:33:46.086468 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:46.704634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12280): Launched 05:33:47.060128 run osmo-msc_10.42.42.6(pid=12281): Launched 05:33:47.397340 run osmo-stp_10.42.42.5(pid=12278): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12278)] 05:33:47.538681 run osmo-stp_10.42.42.5(pid=12278): stdout: | (launched: 2022-12-14_05:33:45.784268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:47.678540 run osmo-stp_10.42.42.5(pid=12278): stderr: | 20221214053346024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053346024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053346025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053346025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053346026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053346026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053346026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:47.814211 run osmo-stp_10.42.42.5(pid=12278): stdout: | (launched: 2022-12-14_05:33:45.784268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:47.945253 run osmo-stp_10.42.42.5(pid=12278): stderr: | 20221214053346024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053346024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053346025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053346025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053346026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053346026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053346026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:48.101098 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12278): Process ended prematurely: osmo-stp_10.42.42.5(pid=12278) [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12278)] [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:33:48.110739 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:33:48.138346 run osmo-hlr_10.42.42.2(pid=12275): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12275)] 05:33:48.188623 run osmo-hlr_10.42.42.2(pid=12275): stdout: | (launched: 2022-12-14_05:33:44.839395) 05:33:48.240534 run osmo-hlr_10.42.42.2(pid=12275): stderr: | 20221214053345013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053345013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053345013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053345013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053345013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053345014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053345026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053345036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053345036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053345037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:48.312195 run osmo-msc_10.42.42.6(pid=12281): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12281)] 05:33:48.361926 run osmo-msc_10.42.42.6(pid=12281): stdout: | (launched: 2022-12-14_05:33:46.995017) 05:33:48.413267 run osmo-msc_10.42.42.6(pid=12281): stderr: | 20221214053347438 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053347438 DLGLOBAL DEBUG validating counter group 0x7f17db298c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053347439 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053347439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053347439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053347439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053347441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053347441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053347441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053347441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:48.464932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12274): Terminating (SIGTERM) 05:33:48.506408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12277): Terminating (SIGTERM) 05:33:48.547952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12280): Terminating (SIGTERM) 05:33:48.589904 --- ParallelTerminationStrategy: PID 12274 died... 05:33:48.609691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12274): Terminated: ok {rc=0} 05:33:48.655822 --- ParallelTerminationStrategy: PID 12277 died... 05:33:48.675389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12277): Terminated: ok {rc=0} 05:33:48.721560 --- ParallelTerminationStrategy: PID 12280 died... 05:33:48.741039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12280): Terminated: ok {rc=0} 05:33:48.828072 bus /sierra_3: Setting Powered False 05:33:49.926107 bus /sierra_3: Setting Powered False 05:33:51.040699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:sysmo --------------------------------------------------------------------- 05:33:52.272390 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:52.276718 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 05:33:52.297890 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 05:33:52.324698 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 05:33:52.409783 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 05:33:52.430904 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 05:33:52.457748 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 05:33:53.042193 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 05:33:53.047186 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:53.058146 tst emergency:sysmo: Using 1 x bts (candidates: 1) 05:33:53.094005 tst emergency_mo_mt_call.py: using LAC 38753 05:33:53.221146 tst emergency_mo_mt_call.py: using RAC 248 05:33:53.346794 tst emergency_mo_mt_call.py: using CellId 38753 05:33:53.474229 tst emergency_mo_mt_call.py: using BVCI 38754 05:33:53.592219 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:53.603274 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:53.614195 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:53.625014 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:53.635801 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:53.646659 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:53.763667 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:53.876929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:54.342564 run create_hlr_db(pid=12289): Launched 05:33:54.457249 bus /sierra_2: Setting Powered False 05:33:55.517416 run create_hlr_db(pid=12289): Terminated: ok {rc=0} 05:33:55.935837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12291): Launched 05:33:56.235757 run osmo-hlr_10.42.42.2(pid=12292): Launched 05:33:56.350975 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:56.881624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12294): Launched 05:33:57.181197 run osmo-stp_10.42.42.5(pid=12295): Launched 05:33:57.310162 tst emergency_mo_mt_call.py: using MSISDN 8525 05:33:57.463316 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:58.001159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12297): Launched 05:33:58.301276 run osmo-msc_10.42.42.6(pid=12298): Launched 05:33:58.469824 run osmo-stp_10.42.42.5(pid=12295): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12295)] 05:33:58.596640 run osmo-stp_10.42.42.5(pid=12295): stdout: | (launched: 2022-12-14_05:33:57.126291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:58.723826 run osmo-stp_10.42.42.5(pid=12295): stderr: | 20221214053357293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053357293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053357293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053357294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053357294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053357294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053357294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:58.848509 run osmo-stp_10.42.42.5(pid=12295): stdout: | (launched: 2022-12-14_05:33:57.126291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:58.967712 run osmo-stp_10.42.42.5(pid=12295): stderr: | 20221214053357293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053357293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053357293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053357294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053357294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053357294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053357294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:59.110551 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12295): Process ended prematurely: osmo-stp_10.42.42.5(pid=12295) [trial-2400↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12295)] [trial-2400↪emergency:sysmo↪emergency_mo_mt_call.py:19] 05:33:59.118697 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 05:33:59.144381 run osmo-hlr_10.42.42.2(pid=12292): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12292)] 05:33:59.191702 run osmo-hlr_10.42.42.2(pid=12292): stdout: | (launched: 2022-12-14_05:33:56.180750) 05:33:59.240418 run osmo-hlr_10.42.42.2(pid=12292): stderr: | 20221214053356355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053356355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053356355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053356355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053356355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053356355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053356367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053356375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053356376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053356376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:59.308917 run osmo-msc_10.42.42.6(pid=12298): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12298)] 05:33:59.355930 run osmo-msc_10.42.42.6(pid=12298): stdout: | (launched: 2022-12-14_05:33:58.246198) 05:33:59.404781 run osmo-msc_10.42.42.6(pid=12298): stderr: | 20221214053358514 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053358515 DLGLOBAL DEBUG validating counter group 0x7f48b2b1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053358515 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053358515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053358515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053358515 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053358517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053358517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053358518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053358518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:59.454015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12291): Terminating (SIGTERM) 05:33:59.493484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12294): Terminating (SIGTERM) 05:33:59.533354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12297): Terminating (SIGTERM) 05:33:59.573590 --- ParallelTerminationStrategy: PID 12291 died... 05:33:59.592834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12291): Terminated: ok {rc=0} 05:33:59.636805 --- ParallelTerminationStrategy: PID 12294 died... 05:33:59.655619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12294): Terminated: ok {rc=0} 05:33:59.699520 --- ParallelTerminationStrategy: PID 12297 died... 05:33:59.718335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12297): Terminated: ok {rc=0} 05:33:59.804196 bus /sierra_3: Setting Powered False 05:34:00.917161 bus /sierra_3: Setting Powered False 05:34:02.037157 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 05:34:03.125791 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:34:03.137388 tst emergency:sysmo: Using 1 x bts (candidates: 1) 05:34:03.175438 tst emergency_preemptive_call.py: using LAC 38754 05:34:03.303765 tst emergency_preemptive_call.py: using RAC 249 05:34:03.430012 tst emergency_preemptive_call.py: using CellId 38754 05:34:03.555579 tst emergency_preemptive_call.py: using BVCI 38755 05:34:03.674427 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:34:03.685528 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:34:03.696344 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:34:03.707123 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:34:03.717922 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:34:03.728581 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:34:03.846855 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:34:03.962681 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:34:04.080453 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:34:04.194511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:04.660310 run create_hlr_db(pid=12300): Launched 05:34:04.775887 bus /sierra_2: Setting Powered False 05:34:05.836225 run create_hlr_db(pid=12300): Terminated: ok {rc=0} 05:34:06.254555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12302): Launched 05:34:06.554222 run osmo-hlr_10.42.42.2(pid=12303): Launched 05:34:06.669207 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:07.189203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12305): Launched 05:34:07.490034 run osmo-stp_10.42.42.5(pid=12306): Launched 05:34:07.613917 tst emergency_preemptive_call.py: using MSISDN 8526 05:34:07.767050 run osmo-msc_10.42.42.6: Starting osmo-msc 05:34:08.304557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12308): Launched 05:34:08.603693 run osmo-msc_10.42.42.6(pid=12309): Launched 05:34:08.778323 run osmo-stp_10.42.42.5(pid=12306): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12306)] 05:34:08.905682 run osmo-stp_10.42.42.5(pid=12306): stdout: | (launched: 2022-12-14_05:34:07.434028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:09.032555 run osmo-stp_10.42.42.5(pid=12306): stderr: | 20221214053407601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053407601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053407601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053407602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053407602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053407602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053407602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:09.157679 run osmo-stp_10.42.42.5(pid=12306): stdout: | (launched: 2022-12-14_05:34:07.434028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:09.277248 run osmo-stp_10.42.42.5(pid=12306): stderr: | 20221214053407601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053407601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053407601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053407602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053407602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053407602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053407602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:09.420101 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12306): Process ended prematurely: osmo-stp_10.42.42.5(pid=12306) [trial-2400↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12306)] [trial-2400↪emergency:sysmo↪emergency_preemptive_call.py:32] 05:34:09.428325 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 05:34:09.453742 run osmo-hlr_10.42.42.2(pid=12303): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12303)] 05:34:09.501137 run osmo-hlr_10.42.42.2(pid=12303): stdout: | (launched: 2022-12-14_05:34:06.498999) 05:34:09.550242 run osmo-hlr_10.42.42.2(pid=12303): stderr: | 20221214053406671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053406671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053406671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053406671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053406671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053406671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053406684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053406692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053406693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053406693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:09.618888 run osmo-msc_10.42.42.6(pid=12309): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12309)] 05:34:09.666103 run osmo-msc_10.42.42.6(pid=12309): stdout: | (launched: 2022-12-14_05:34:08.548727) 05:34:09.714941 run osmo-msc_10.42.42.6(pid=12309): stderr: | 20221214053408817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053408817 DLGLOBAL DEBUG validating counter group 0x7f203c906c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053408817 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053408817 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053408817 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053408817 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053408819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053408820 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053408820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053408820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:34:09.764304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12302): Terminating (SIGTERM) 05:34:09.803927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12305): Terminating (SIGTERM) 05:34:09.843434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12308): Terminating (SIGTERM) 05:34:09.883280 --- ParallelTerminationStrategy: PID 12302 died... 05:34:09.902336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12302): Terminated: ok {rc=0} 05:34:09.946247 --- ParallelTerminationStrategy: PID 12305 died... 05:34:09.965131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12305): Terminated: ok {rc=0} 05:34:10.009057 --- ParallelTerminationStrategy: PID 12308 died... 05:34:10.027802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12308): Terminated: ok {rc=0} 05:34:10.113226 bus /sierra_9: Setting Powered False 05:34:11.211905 bus /sierra_9: Setting Powered False 05:34:12.325763 bus /sierra_8: Setting Powered False 05:34:13.423499 bus /sierra_8: Setting Powered False 05:34:14.535109 bus /sierra_3: Setting Powered False 05:34:15.631900 bus /sierra_3: Setting Powered False 05:34:16.751811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:sysmo --------------------------------------------------------------------- 05:34:18.006670 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:34:18.011218 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 05:34:18.031949 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 05:34:18.071315 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 05:34:18.156419 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 05:34:18.176631 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 05:34:18.214333 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 05:34:18.803122 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 05:34:18.854094 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.864674 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:18.898689 tst cs_paging_gprs_active.py: using LAC 38755 05:34:19.023035 tst cs_paging_gprs_active.py: using RAC 250 05:34:19.142752 tst cs_paging_gprs_active.py: using CellId 38755 05:34:19.262581 tst cs_paging_gprs_active.py: using BVCI 38756 05:34:19.374766 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.385235 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.395528 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.405811 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.415903 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.426464 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.436858 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.447234 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.457903 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:19.580106 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:19.695624 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:34:19.901668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:20.209948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12314): Launched 05:34:20.475583 run iperf3-srv_10.42.42.10(pid=12315): Launched 05:34:20.590511 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:34:20.796061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:21.103531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Launched 05:34:21.369812 run iperf3-srv_10.42.42.10(pid=12317): Launched 05:34:21.484025 tst cs_paging_gprs_active.py:38: start network... 05:34:21.688102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:22.159652 run create_hlr_db(pid=12318): Launched 05:34:22.276584 bus /sierra_2: Setting Powered False 05:34:23.337256 run create_hlr_db(pid=12318): Terminated: ok {rc=0} 05:34:23.762989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12320): Launched 05:34:24.069224 run osmo-hlr_10.42.42.2(pid=12321): Launched 05:34:24.186208 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:24.726295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12323): Launched 05:34:25.030773 run osmo-stp_10.42.42.5(pid=12324): Launched 05:34:25.147351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:26.647519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12326): Launched 05:34:26.764592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:27.023411 run patchelf(pid=12327): Launched 05:34:27.194403 run osmo-stp_10.42.42.5(pid=12324): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12324)] 05:34:27.324233 run osmo-stp_10.42.42.5(pid=12324): stdout: | (launched: 2022-12-14_05:34:24.975138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:27.455502 run osmo-stp_10.42.42.5(pid=12324): stderr: | 20221214053425143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053425143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053425143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053425143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053425144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053425144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053425144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:27.587188 run osmo-stp_10.42.42.5(pid=12324): stdout: | (launched: 2022-12-14_05:34:24.975138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:27.713224 run osmo-stp_10.42.42.5(pid=12324): stderr: | 20221214053425143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053425143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053425143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053425143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053425144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053425144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053425144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:27.861355 run patchelf(pid=12327): Terminating (SIGINT) 05:34:28.033415 run patchelf(pid=12327): Terminated: ok {rc=0} 05:34:28.157628 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12324): Process ended prematurely: osmo-stp_10.42.42.5(pid=12324) [trial-2400↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12324)] [trial-2400↪gprs:sysmo↪cs_paging_gprs_active.py:38] 05:34:28.166864 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 05:34:28.193653 run osmo-hlr_10.42.42.2(pid=12321): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12321)] 05:34:28.241329 run osmo-hlr_10.42.42.2(pid=12321): stdout: | (launched: 2022-12-14_05:34:24.013199) 05:34:28.290184 run osmo-hlr_10.42.42.2(pid=12321): stderr: | 20221214053424185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053424185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053424185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053424185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053424186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053424186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053424196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053424204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053424205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053424205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:28.339469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12314): Terminating (SIGTERM) 05:34:28.378996 run iperf3-srv_10.42.42.10(pid=12315): Terminating (SIGTERM) 05:34:28.418404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Terminating (SIGTERM) 05:34:28.457903 run iperf3-srv_10.42.42.10(pid=12317): Terminating (SIGTERM) 05:34:28.497275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12320): Terminating (SIGTERM) 05:34:28.536834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12323): Terminating (SIGTERM) 05:34:28.576294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12326): Terminating (SIGTERM) 05:34:28.615819 --- ParallelTerminationStrategy: PID 12314 died... 05:34:28.634923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12314): Terminated: ok {rc=0} 05:34:28.678771 --- ParallelTerminationStrategy: PID 12315 died... 05:34:28.697474 run iperf3-srv_10.42.42.10(pid=12315): Terminated {rc=256} 05:34:28.741082 --- ParallelTerminationStrategy: PID 12316 died... 05:34:28.759863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Terminated: ok {rc=0} 05:34:28.803681 --- ParallelTerminationStrategy: PID 12317 died... 05:34:28.822431 run iperf3-srv_10.42.42.10(pid=12317): Terminated {rc=256} 05:34:28.866103 --- ParallelTerminationStrategy: PID 12320 died... 05:34:28.884854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12320): Terminated: ok {rc=0} 05:34:28.928712 --- ParallelTerminationStrategy: PID 12323 died... 05:34:28.947739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12323): Terminated: ok {rc=0} 05:34:28.991589 --- ParallelTerminationStrategy: PID 12326 died... 05:34:29.010350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12326): Terminated: ok {rc=0} 05:34:29.095724 bus /gobi_0: Setting Powered False 05:34:30.193750 bus /gobi_0: Setting Powered False 05:34:31.325998 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo iperf3.py ---------------------------------------------- 05:34:32.491860 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:32.503385 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:32.539314 tst iperf3.py: using LAC 38756 05:34:32.668736 tst iperf3.py: using RAC 251 05:34:32.796842 tst iperf3.py: using CellId 38756 05:34:32.924832 tst iperf3.py: using BVCI 38757 05:34:33.044390 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.055315 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.066132 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.076832 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.087522 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.098210 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.109527 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.120551 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:33.131387 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:33.249940 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:34:33.471541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:33.801142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12328): Launched 05:34:34.087028 run iperf3-srv_10.42.42.10(pid=12329): Launched 05:34:34.209514 tst iperf3.py:8: start network... 05:34:34.431002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:34.937725 run create_hlr_db(pid=12330): Launched 05:34:35.070587 bus /gobi_6: Setting Powered False 05:34:36.135253 run create_hlr_db(pid=12330): Terminated: ok {rc=0} 05:34:36.570271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12332): Launched 05:34:36.875387 run osmo-hlr_10.42.42.2(pid=12333): Launched 05:34:36.991730 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:37.518408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12335): Launched 05:34:37.822392 run osmo-stp_10.42.42.5(pid=12336): Launched 05:34:37.938730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:38.464471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12338): Launched 05:34:38.582083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:38.840804 run patchelf(pid=12339): Launched 05:34:39.010852 run osmo-stp_10.42.42.5(pid=12336): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12336)] 05:34:39.140490 run osmo-stp_10.42.42.5(pid=12336): stdout: | (launched: 2022-12-14_05:34:37.766697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:39.271136 run osmo-stp_10.42.42.5(pid=12336): stderr: | 20221214053437935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053437935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053437935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053437936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053437936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053437936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053437936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:39.402259 run osmo-stp_10.42.42.5(pid=12336): stdout: | (launched: 2022-12-14_05:34:37.766697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:39.527037 run osmo-stp_10.42.42.5(pid=12336): stderr: | 20221214053437935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053437935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053437935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053437936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053437936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053437936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053437936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:39.674900 run patchelf(pid=12339): Terminating (SIGINT) 05:34:39.845687 run patchelf(pid=12339): Terminated: ok {rc=0} 05:34:39.969537 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12336): Process ended prematurely: osmo-stp_10.42.42.5(pid=12336) [trial-2400↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12336)] [trial-2400↪gprs:sysmo↪iperf3.py:8] 05:34:39.979285 tst iperf3.py:8: Test FAILED (7.5 sec) 05:34:40.005999 run osmo-hlr_10.42.42.2(pid=12333): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12333)] 05:34:40.053402 run osmo-hlr_10.42.42.2(pid=12333): stdout: | (launched: 2022-12-14_05:34:36.819651) 05:34:40.102286 run osmo-hlr_10.42.42.2(pid=12333): stderr: | 20221214053436992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053436992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053436992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053436992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053436993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053436993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053437004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053437012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053437012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053437012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:40.151681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12328): Terminating (SIGTERM) 05:34:40.191448 run iperf3-srv_10.42.42.10(pid=12329): Terminating (SIGTERM) 05:34:40.230838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12332): Terminating (SIGTERM) 05:34:40.270577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12335): Terminating (SIGTERM) 05:34:40.309868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12338): Terminating (SIGTERM) 05:34:40.349599 --- ParallelTerminationStrategy: PID 12328 died... 05:34:40.368745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12328): Terminated: ok {rc=0} 05:34:40.412780 --- ParallelTerminationStrategy: PID 12329 died... 05:34:40.431595 run iperf3-srv_10.42.42.10(pid=12329): Terminated {rc=256} 05:34:40.475440 --- ParallelTerminationStrategy: PID 12332 died... 05:34:40.494270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12332): Terminated: ok {rc=0} 05:34:40.538119 --- ParallelTerminationStrategy: PID 12335 died... 05:34:40.556902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12335): Terminated: ok {rc=0} 05:34:40.600626 --- ParallelTerminationStrategy: PID 12338 died... 05:34:40.619496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12338): Terminated: ok {rc=0} 05:34:40.702585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo iperf3m4.py ---------------------------------------------- 05:34:41.851108 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:41.862785 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:41.900068 tst iperf3m4.py: using LAC 38757 05:34:42.028332 tst iperf3m4.py: using RAC 252 05:34:42.149645 tst iperf3m4.py: using CellId 38757 05:34:42.278576 tst iperf3m4.py: using BVCI 38758 05:34:42.399268 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.410294 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.421265 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.431928 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.442599 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.453255 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.464107 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.474747 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:42.485523 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:42.603906 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:42.722445 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:42.842212 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:42.962151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:34:43.185276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:43.514872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12340): Launched 05:34:43.800316 run iperf3-srv_10.42.42.10(pid=12341): Launched 05:34:43.923295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:34:44.146319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:44.476906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12342): Launched 05:34:44.762402 run iperf3-srv_10.42.42.10(pid=12343): Launched 05:34:44.884914 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:34:45.107549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:45.436921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12344): Launched 05:34:45.721138 run iperf3-srv_10.42.42.10(pid=12345): Launched 05:34:45.844887 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:34:46.071237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:46.417737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12346): Launched 05:34:46.720132 run iperf3-srv_10.42.42.10(pid=12347): Launched 05:34:46.871099 tst iperf3m4.py:8: start network... 05:34:47.083717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:47.567891 run create_hlr_db(pid=12348): Launched 05:34:47.684243 bus /gobi_6: Setting Powered False 05:34:48.745549 run create_hlr_db(pid=12348): Terminated: ok {rc=0} 05:34:49.173501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12350): Launched 05:34:49.479115 run osmo-hlr_10.42.42.2(pid=12351): Launched 05:34:49.595950 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:50.134268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12353): Launched 05:34:50.439627 run osmo-stp_10.42.42.5(pid=12354): Launched 05:34:50.558454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:51.093921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12356): Launched 05:34:51.213708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:51.476927 run patchelf(pid=12357): Launched 05:34:51.651922 run osmo-stp_10.42.42.5(pid=12354): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12354)] 05:34:51.785835 run osmo-stp_10.42.42.5(pid=12354): stdout: | (launched: 2022-12-14_05:34:50.383901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:51.921409 run osmo-stp_10.42.42.5(pid=12354): stderr: | 20221214053450550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053450550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053450550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053450551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053450551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053450551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053450551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:52.056703 run osmo-stp_10.42.42.5(pid=12354): stdout: | (launched: 2022-12-14_05:34:50.383901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:52.185903 run osmo-stp_10.42.42.5(pid=12354): stderr: | 20221214053450550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053450550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053450550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053450551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053450551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053450551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053450551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:52.339478 run patchelf(pid=12357): Terminating (SIGINT) 05:34:52.516139 run patchelf(pid=12357): Terminated: ok {rc=0} 05:34:52.643685 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12354): Process ended prematurely: osmo-stp_10.42.42.5(pid=12354) [trial-2400↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12354)] [trial-2400↪gprs:sysmo↪iperf3m4.py:8] 05:34:52.653255 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:34:52.680892 run osmo-hlr_10.42.42.2(pid=12351): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12351)] 05:34:52.730037 run osmo-hlr_10.42.42.2(pid=12351): stdout: | (launched: 2022-12-14_05:34:49.423209) 05:34:52.780181 run osmo-hlr_10.42.42.2(pid=12351): stderr: | 20221214053449596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053449596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053449596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053449596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053449596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053449596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053449608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053449616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053449616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053449616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:52.830957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12340): Terminating (SIGTERM) 05:34:52.871648 run iperf3-srv_10.42.42.10(pid=12341): Terminating (SIGTERM) 05:34:52.912276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12342): Terminating (SIGTERM) 05:34:52.952869 run iperf3-srv_10.42.42.10(pid=12343): Terminating (SIGTERM) 05:34:52.993251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12344): Terminating (SIGTERM) 05:34:53.033826 run iperf3-srv_10.42.42.10(pid=12345): Terminating (SIGTERM) 05:34:53.074515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12346): Terminating (SIGTERM) 05:34:53.115003 run iperf3-srv_10.42.42.10(pid=12347): Terminating (SIGTERM) 05:34:53.156108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12350): Terminating (SIGTERM) 05:34:53.196880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12353): Terminating (SIGTERM) 05:34:53.237537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12356): Terminating (SIGTERM) 05:34:53.278211 --- ParallelTerminationStrategy: PID 12340 died... 05:34:53.297832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12340): Terminated: ok {rc=0} 05:34:53.342832 --- ParallelTerminationStrategy: PID 12341 died... 05:34:53.361925 run iperf3-srv_10.42.42.10(pid=12341): Terminated {rc=256} 05:34:53.406356 --- ParallelTerminationStrategy: PID 12342 died... 05:34:53.425412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12342): Terminated: ok {rc=0} 05:34:53.470288 --- ParallelTerminationStrategy: PID 12343 died... 05:34:53.489529 run iperf3-srv_10.42.42.10(pid=12343): Terminated {rc=256} 05:34:53.534246 --- ParallelTerminationStrategy: PID 12344 died... 05:34:53.553335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12344): Terminated: ok {rc=0} 05:34:53.598231 --- ParallelTerminationStrategy: PID 12345 died... 05:34:53.617428 run iperf3-srv_10.42.42.10(pid=12345): Terminated {rc=256} 05:34:53.661999 --- ParallelTerminationStrategy: PID 12346 died... 05:34:53.680939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12346): Terminated: ok {rc=0} 05:34:53.725652 --- ParallelTerminationStrategy: PID 12347 died... 05:34:53.744538 run iperf3-srv_10.42.42.10(pid=12347): Terminated {rc=256} 05:34:53.789317 --- ParallelTerminationStrategy: PID 12350 died... 05:34:53.808551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12350): Terminated: ok {rc=0} 05:34:53.853126 --- ParallelTerminationStrategy: PID 12353 died... 05:34:53.872174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12353): Terminated: ok {rc=0} 05:34:53.916846 --- ParallelTerminationStrategy: PID 12356 died... 05:34:53.936457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12356): Terminated: ok {rc=0} 05:34:54.024240 bus /gobi_4: Setting Powered False 05:34:55.127930 bus /gobi_4: Setting Powered False 05:34:56.246501 bus /gobi_1: Setting Powered False 05:34:57.346321 bus /gobi_1: Setting Powered False 05:34:58.463086 bus /gobi_0: Setting Powered False 05:34:59.561896 bus /gobi_0: Setting Powered False 05:35:00.679330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo ping.py ---------------------------------------------- 05:35:01.789997 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:01.802675 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:35:01.840565 tst ping.py: using LAC 38758 05:35:01.968614 tst ping.py: using RAC 253 05:35:02.101188 tst ping.py: using CellId 38758 05:35:02.226498 tst ping.py: using BVCI 38759 05:35:02.342399 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.353459 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.364208 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.374894 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.386043 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.397046 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.408206 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:02.419362 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:35:02.540140 tst ping.py:19: start network... 05:35:02.763920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:03.276812 run create_hlr_db(pid=12361): Launched 05:35:03.409487 bus /gobi_6: Setting Powered False 05:35:04.475104 run create_hlr_db(pid=12361): Terminated: ok {rc=0} 05:35:04.933909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12363): Launched 05:35:05.266257 run osmo-hlr_10.42.42.2(pid=12364): Launched 05:35:05.393589 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:05.965565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12366): Launched 05:35:06.293745 run osmo-stp_10.42.42.5(pid=12367): Launched 05:35:06.419286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:06.987164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12369): Launched 05:35:07.114489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:07.393606 run patchelf(pid=12370): Launched 05:35:07.576757 run osmo-stp_10.42.42.5(pid=12367): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12367)] 05:35:07.716110 run osmo-stp_10.42.42.5(pid=12367): stdout: | (launched: 2022-12-14_05:35:06.233948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:07.857399 run osmo-stp_10.42.42.5(pid=12367): stderr: | 20221214053506426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053506426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053506426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053506427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053506427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053506427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053506427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:07.999598 run osmo-stp_10.42.42.5(pid=12367): stdout: | (launched: 2022-12-14_05:35:06.233948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:08.134575 run osmo-stp_10.42.42.5(pid=12367): stderr: | 20221214053506426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053506426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053506426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053506427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053506427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053506427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053506427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:08.294498 run patchelf(pid=12370): Terminating (SIGINT) 05:35:08.478357 run patchelf(pid=12370): Terminated: ok {rc=0} 05:35:08.610752 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12367): Process ended prematurely: osmo-stp_10.42.42.5(pid=12367) [trial-2400↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12367)] [trial-2400↪gprs:sysmo↪ping.py:22] 05:35:08.620200 tst ping.py:22: Test FAILED (6.8 sec) 05:35:08.648190 run osmo-hlr_10.42.42.2(pid=12364): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12364)] 05:35:08.698652 run osmo-hlr_10.42.42.2(pid=12364): stdout: | (launched: 2022-12-14_05:35:05.205827) 05:35:08.750856 run osmo-hlr_10.42.42.2(pid=12364): stderr: | 20221214053505405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053505405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053505405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053505405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053505405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053505405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053505417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053505427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053505428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053505428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:08.803504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12363): Terminating (SIGTERM) 05:35:08.845935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12366): Terminating (SIGTERM) 05:35:08.888414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12369): Terminating (SIGTERM) 05:35:08.931632 --- ParallelTerminationStrategy: PID 12363 died... 05:35:08.952242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12363): Terminated: ok {rc=0} 05:35:08.999428 --- ParallelTerminationStrategy: PID 12366 died... 05:35:09.019455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12366): Terminated: ok {rc=0} 05:35:09.066375 --- ParallelTerminationStrategy: PID 12369 died... 05:35:09.086421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12369): Terminated: ok {rc=0} 05:35:09.174572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 05:35:10.262870 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.274318 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:35:10.310772 tst ping_idle_ping.py: using LAC 38759 05:35:10.443211 tst ping_idle_ping.py: using RAC 254 05:35:10.575598 tst ping_idle_ping.py: using CellId 38759 05:35:10.708290 tst ping_idle_ping.py: using BVCI 38760 05:35:10.831023 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.842377 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.853735 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.864740 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.875656 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.886716 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.897781 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:35:10.908719 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:35:11.034430 tst ping_idle_ping.py:24: start network... 05:35:11.243707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:11.722737 run create_hlr_db(pid=12371): Launched 05:35:11.842323 bus /gobi_6: Setting Powered False 05:35:12.904037 run create_hlr_db(pid=12371): Terminated: ok {rc=0} 05:35:13.355463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12373): Launched 05:35:13.685576 run osmo-hlr_10.42.42.2(pid=12374): Launched 05:35:13.805833 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:14.351211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12376): Launched 05:35:14.660911 run osmo-stp_10.42.42.5(pid=12377): Launched 05:35:14.779804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:15.315710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12379): Launched 05:35:15.434732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:15.697102 run patchelf(pid=12380): Launched 05:35:15.871186 run osmo-stp_10.42.42.5(pid=12377): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12377)] 05:35:16.005191 run osmo-stp_10.42.42.5(pid=12377): stdout: | (launched: 2022-12-14_05:35:14.604405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:16.141928 run osmo-stp_10.42.42.5(pid=12377): stderr: | 20221214053514776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053514776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053514777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053514777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053514777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053514778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053514778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:16.278565 run osmo-stp_10.42.42.5(pid=12377): stdout: | (launched: 2022-12-14_05:35:14.604405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:16.408927 run osmo-stp_10.42.42.5(pid=12377): stderr: | 20221214053514776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053514776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053514777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053514777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053514777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053514778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053514778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:16.563448 run patchelf(pid=12380): Terminating (SIGINT) 05:35:16.740889 run patchelf(pid=12380): Terminated: ok {rc=0} 05:35:16.870548 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12377): Process ended prematurely: osmo-stp_10.42.42.5(pid=12377) [trial-2400↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12377)] [trial-2400↪gprs:sysmo↪ping_idle_ping.py:27] 05:35:16.880487 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:35:16.908234 run osmo-hlr_10.42.42.2(pid=12374): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12374)] 05:35:16.959513 run osmo-hlr_10.42.42.2(pid=12374): stdout: | (launched: 2022-12-14_05:35:13.625837) 05:35:17.011155 run osmo-hlr_10.42.42.2(pid=12374): stderr: | 20221214053513807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053513807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053513807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053513807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053513807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053513807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053513821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053513830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053513830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053513830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:17.063349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12373): Terminating (SIGTERM) 05:35:17.106155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12376): Terminating (SIGTERM) 05:35:17.149142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12379): Terminating (SIGTERM) 05:35:17.191117 --- ParallelTerminationStrategy: PID 12373 died... 05:35:17.211873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12373): Terminated: ok {rc=0} 05:35:17.257834 --- ParallelTerminationStrategy: PID 12376 died... 05:35:17.276844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12376): Terminated: ok {rc=0} 05:35:17.321166 --- ParallelTerminationStrategy: PID 12379 died... 05:35:17.340264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12379): Terminated: ok {rc=0} 05:35:17.423873 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 05:35:18.710633 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:35:18.717097 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:35:18.737648 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:35:18.776670 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:35:18.862415 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:35:18.882933 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:35:18.921092 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:35:19.513008 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:35:19.565071 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.575848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:19.611262 tst cs_paging_gprs_active.py: using LAC 38760 05:35:19.736864 tst cs_paging_gprs_active.py: using RAC 255 05:35:19.859640 tst cs_paging_gprs_active.py: using CellId 38760 05:35:19.983069 tst cs_paging_gprs_active.py: using BVCI 38761 05:35:20.099092 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.110080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.120530 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.131722 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.142756 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.153946 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.165077 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.175914 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:20.187190 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:20.309563 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:20.428763 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:35:20.641481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:20.958381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12384): Launched 05:35:21.234584 run iperf3-srv_10.42.42.10(pid=12385): Launched 05:35:21.353661 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:35:21.566024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:21.882366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12386): Launched 05:35:22.156731 run iperf3-srv_10.42.42.10(pid=12387): Launched 05:35:22.275858 tst cs_paging_gprs_active.py:38: start network... 05:35:22.488290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:22.975946 run create_hlr_db(pid=12388): Launched 05:35:23.096302 bus /gobi_6: Setting Powered False 05:35:24.159125 run create_hlr_db(pid=12388): Terminated: ok {rc=0} 05:35:24.596683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12390): Launched 05:35:24.911632 run osmo-hlr_10.42.42.2(pid=12391): Launched 05:35:25.032176 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:25.588376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12393): Launched 05:35:25.904378 run osmo-stp_10.42.42.5(pid=12394): Launched 05:35:26.024937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:26.566441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12396): Launched 05:35:26.687063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:26.953320 run patchelf(pid=12397): Launched 05:35:27.129037 run osmo-stp_10.42.42.5(pid=12394): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12394)] 05:35:27.262656 run osmo-stp_10.42.42.5(pid=12394): stdout: | (launched: 2022-12-14_05:35:25.846890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:27.397982 run osmo-stp_10.42.42.5(pid=12394): stderr: | 20221214053526016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053526016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053526017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053526017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053526018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053526018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053526018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:27.534792 run osmo-stp_10.42.42.5(pid=12394): stdout: | (launched: 2022-12-14_05:35:25.846890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:27.663666 run osmo-stp_10.42.42.5(pid=12394): stderr: | 20221214053526016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053526016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053526017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053526017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053526018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053526018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053526018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:27.816245 run patchelf(pid=12397): Terminating (SIGINT) 05:35:27.993129 run patchelf(pid=12397): Terminated: ok {rc=0} 05:35:28.121368 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12394): Process ended prematurely: osmo-stp_10.42.42.5(pid=12394) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12394)] [trial-2400↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:35:28.131285 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 05:35:28.158636 run osmo-hlr_10.42.42.2(pid=12391): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12391)] 05:35:28.207511 run osmo-hlr_10.42.42.2(pid=12391): stdout: | (launched: 2022-12-14_05:35:24.854266) 05:35:28.257588 run osmo-hlr_10.42.42.2(pid=12391): stderr: | 20221214053525032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053525032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053525032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053525032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053525032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053525032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053525045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053525053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053525053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053525053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:28.308148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12384): Terminating (SIGTERM) 05:35:28.348850 run iperf3-srv_10.42.42.10(pid=12385): Terminating (SIGTERM) 05:35:28.389341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12386): Terminating (SIGTERM) 05:35:28.429964 run iperf3-srv_10.42.42.10(pid=12387): Terminating (SIGTERM) 05:35:28.470231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12390): Terminating (SIGTERM) 05:35:28.510643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12393): Terminating (SIGTERM) 05:35:28.551105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12396): Terminating (SIGTERM) 05:35:28.591768 --- ParallelTerminationStrategy: PID 12384 died... 05:35:28.611588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12384): Terminated: ok {rc=0} 05:35:28.656185 --- ParallelTerminationStrategy: PID 12385 died... 05:35:28.675414 run iperf3-srv_10.42.42.10(pid=12385): Terminated {rc=256} 05:35:28.720017 --- ParallelTerminationStrategy: PID 12386 died... 05:35:28.739380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12386): Terminated: ok {rc=0} 05:35:28.783608 --- ParallelTerminationStrategy: PID 12387 died... 05:35:28.802736 run iperf3-srv_10.42.42.10(pid=12387): Terminated {rc=256} 05:35:28.847054 --- ParallelTerminationStrategy: PID 12390 died... 05:35:28.866221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12390): Terminated: ok {rc=0} 05:35:28.910505 --- ParallelTerminationStrategy: PID 12393 died... 05:35:28.929773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12393): Terminated: ok {rc=0} 05:35:28.974338 --- ParallelTerminationStrategy: PID 12396 died... 05:35:28.993572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12396): Terminated: ok {rc=0} 05:35:29.079901 bus /gobi_0: Setting Powered False 05:35:30.180530 bus /gobi_0: Setting Powered False 05:35:31.295022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:35:32.440638 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:32.452188 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:32.489452 tst iperf3.py: using LAC 38761 05:35:32.614356 tst iperf3.py: using RAC 1 05:35:32.737165 tst iperf3.py: using CellId 38761 05:35:32.860308 tst iperf3.py: using BVCI 38762 05:35:32.975938 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:32.986877 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:32.997535 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:33.008071 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:33.019105 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:33.030147 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:33.041380 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:33.052376 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:33.063687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:33.187636 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:35:33.416014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:33.753786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12398): Launched 05:35:34.045727 run iperf3-srv_10.42.42.10(pid=12399): Launched 05:35:34.171567 tst iperf3.py:8: start network... 05:35:34.398373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:34.917675 run create_hlr_db(pid=12400): Launched 05:35:35.045614 bus /gobi_6: Setting Powered False 05:35:36.107667 run create_hlr_db(pid=12400): Terminated: ok {rc=0} 05:35:36.543445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12402): Launched 05:35:36.858413 run osmo-hlr_10.42.42.2(pid=12403): Launched 05:35:36.978463 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:37.533994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12405): Launched 05:35:37.847760 run osmo-stp_10.42.42.5(pid=12406): Launched 05:35:37.967251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:38.510286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12408): Launched 05:35:38.631481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:38.898183 run patchelf(pid=12409): Launched 05:35:39.073723 run osmo-stp_10.42.42.5(pid=12406): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12406)] 05:35:39.207232 run osmo-stp_10.42.42.5(pid=12406): stdout: | (launched: 2022-12-14_05:35:37.790677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:39.342679 run osmo-stp_10.42.42.5(pid=12406): stderr: | 20221214053537962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053537962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053537962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053537963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053537963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053537963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053537963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:39.477901 run osmo-stp_10.42.42.5(pid=12406): stdout: | (launched: 2022-12-14_05:35:37.790677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:39.607605 run osmo-stp_10.42.42.5(pid=12406): stderr: | 20221214053537962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053537962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053537962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053537963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053537963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053537963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053537963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:39.760219 run patchelf(pid=12409): Terminating (SIGINT) 05:35:39.936801 run patchelf(pid=12409): Terminated: ok {rc=0} 05:35:40.064788 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12406): Process ended prematurely: osmo-stp_10.42.42.5(pid=12406) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12406)] [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 05:35:40.074769 tst iperf3.py:8: Test FAILED (7.7 sec) 05:35:40.102119 run osmo-hlr_10.42.42.2(pid=12403): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12403)] 05:35:40.150814 run osmo-hlr_10.42.42.2(pid=12403): stdout: | (launched: 2022-12-14_05:35:36.800569) 05:35:40.200828 run osmo-hlr_10.42.42.2(pid=12403): stderr: | 20221214053536978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053536978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053536978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053536978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053536979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053536979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053536990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053536998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053536999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053536999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:40.251197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12398): Terminating (SIGTERM) 05:35:40.291774 run iperf3-srv_10.42.42.10(pid=12399): Terminating (SIGTERM) 05:35:40.332281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12402): Terminating (SIGTERM) 05:35:40.372777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12405): Terminating (SIGTERM) 05:35:40.413155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12408): Terminating (SIGTERM) 05:35:40.453863 --- ParallelTerminationStrategy: PID 12398 died... 05:35:40.473429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12398): Terminated: ok {rc=0} 05:35:40.517642 --- ParallelTerminationStrategy: PID 12399 died... 05:35:40.536422 run iperf3-srv_10.42.42.10(pid=12399): Terminated {rc=256} 05:35:40.580646 --- ParallelTerminationStrategy: PID 12402 died... 05:35:40.599661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12402): Terminated: ok {rc=0} 05:35:40.643756 --- ParallelTerminationStrategy: PID 12405 died... 05:35:40.662697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12405): Terminated: ok {rc=0} 05:35:40.706754 --- ParallelTerminationStrategy: PID 12408 died... 05:35:40.725719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12408): Terminated: ok {rc=0} 05:35:40.811631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:35:41.960898 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:41.972452 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:42.011033 tst iperf3m4.py: using LAC 38762 05:35:42.144016 tst iperf3m4.py: using RAC 2 05:35:42.271428 tst iperf3m4.py: using CellId 38762 05:35:42.394692 tst iperf3m4.py: using BVCI 38763 05:35:42.510736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.521864 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.532929 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.543713 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.554811 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.565881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.577134 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.588035 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:42.599160 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:42.721701 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:42.843144 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:42.965097 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:43.083636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:35:43.296822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:43.616142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12410): Launched 05:35:43.890766 run iperf3-srv_10.42.42.10(pid=12411): Launched 05:35:44.008546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:35:44.220361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:44.536372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12412): Launched 05:35:44.810340 run iperf3-srv_10.42.42.10(pid=12413): Launched 05:35:44.930428 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:35:45.141347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:45.458346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12414): Launched 05:35:45.735199 run iperf3-srv_10.42.42.10(pid=12415): Launched 05:35:45.880631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:35:46.100897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:46.477746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12416): Launched 05:35:46.766420 run iperf3-srv_10.42.42.10(pid=12417): Launched 05:35:46.887138 tst iperf3m4.py:8: start network... 05:35:47.101707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:47.595099 run create_hlr_db(pid=12418): Launched 05:35:47.715314 bus /gobi_6: Setting Powered False 05:35:48.776839 run create_hlr_db(pid=12418): Terminated: ok {rc=0} 05:35:49.235302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Launched 05:35:49.572496 run osmo-hlr_10.42.42.2(pid=12421): Launched 05:35:49.699719 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:50.282018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Launched 05:35:50.619296 run osmo-stp_10.42.42.5(pid=12424): Launched 05:35:50.746230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:51.323962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Launched 05:35:51.453842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:51.738175 run patchelf(pid=12427): Launched 05:35:51.924077 run osmo-stp_10.42.42.5(pid=12424): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] 05:35:52.069698 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-14_05:35:50.558255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:52.215059 run osmo-stp_10.42.42.5(pid=12424): stderr: | 20221214053550749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053550749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053550750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053550750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053550751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053550751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053550751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:52.358881 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-14_05:35:50.558255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:52.495936 run osmo-stp_10.42.42.5(pid=12424): stderr: | 20221214053550749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053550749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053550750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053550750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053550751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053550751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053550751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:52.658704 run patchelf(pid=12427): Terminating (SIGINT) 05:35:52.845959 run patchelf(pid=12427): Terminated: ok {rc=0} 05:35:52.980850 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 05:35:52.991203 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:35:53.020153 run osmo-hlr_10.42.42.2(pid=12421): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12421)] 05:35:53.070237 run osmo-hlr_10.42.42.2(pid=12421): stdout: | (launched: 2022-12-14_05:35:49.511335) 05:35:53.122152 run osmo-hlr_10.42.42.2(pid=12421): stderr: | 20221214053549712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053549712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053549712 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053549712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053549712 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053549712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053549727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053549736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053549736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053549736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:53.174364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12410): Terminating (SIGTERM) 05:35:53.215907 run iperf3-srv_10.42.42.10(pid=12411): Terminating (SIGTERM) 05:35:53.257496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12412): Terminating (SIGTERM) 05:35:53.299053 run iperf3-srv_10.42.42.10(pid=12413): Terminating (SIGTERM) 05:35:53.340520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12414): Terminating (SIGTERM) 05:35:53.382162 run iperf3-srv_10.42.42.10(pid=12415): Terminating (SIGTERM) 05:35:53.423593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12416): Terminating (SIGTERM) 05:35:53.465054 run iperf3-srv_10.42.42.10(pid=12417): Terminating (SIGTERM) 05:35:53.506193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminating (SIGTERM) 05:35:53.548094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminating (SIGTERM) 05:35:53.589705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Terminating (SIGTERM) 05:35:53.631709 --- ParallelTerminationStrategy: PID 12410 died... 05:35:53.651656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12410): Terminated: ok {rc=0} 05:35:53.698194 --- ParallelTerminationStrategy: PID 12411 died... 05:35:53.717927 run iperf3-srv_10.42.42.10(pid=12411): Terminated {rc=256} 05:35:53.764061 --- ParallelTerminationStrategy: PID 12412 died... 05:35:53.783665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12412): Terminated: ok {rc=0} 05:35:53.829934 --- ParallelTerminationStrategy: PID 12413 died... 05:35:53.849658 run iperf3-srv_10.42.42.10(pid=12413): Terminated {rc=256} 05:35:53.895795 --- ParallelTerminationStrategy: PID 12414 died... 05:35:53.915327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12414): Terminated: ok {rc=0} 05:35:53.961730 --- ParallelTerminationStrategy: PID 12415 died... 05:35:53.981503 run iperf3-srv_10.42.42.10(pid=12415): Terminated {rc=256} 05:35:54.028255 --- ParallelTerminationStrategy: PID 12416 died... 05:35:54.048016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12416): Terminated: ok {rc=0} 05:35:54.094265 --- ParallelTerminationStrategy: PID 12417 died... 05:35:54.114066 run iperf3-srv_10.42.42.10(pid=12417): Terminated {rc=256} 05:35:54.160125 --- ParallelTerminationStrategy: PID 12420 died... 05:35:54.179667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminated: ok {rc=0} 05:35:54.225802 --- ParallelTerminationStrategy: PID 12423 died... 05:35:54.245595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminated: ok {rc=0} 05:35:54.291873 --- ParallelTerminationStrategy: PID 12426 died... 05:35:54.311732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Terminated: ok {rc=0} 05:35:54.400794 bus /gobi_4: Setting Powered False 05:35:55.500442 bus /gobi_4: Setting Powered False 05:35:56.618202 bus /gobi_1: Setting Powered False 05:35:57.717715 bus /gobi_1: Setting Powered False 05:35:58.835848 bus /gobi_0: Setting Powered False 05:35:59.934869 bus /gobi_0: Setting Powered False 05:36:01.052225 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 05:36:02.177521 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.189603 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:36:02.233390 tst ping.py: using LAC 38763 05:36:02.364581 tst ping.py: using RAC 3 05:36:02.497357 tst ping.py: using CellId 38763 05:36:02.627077 tst ping.py: using BVCI 38764 05:36:02.747687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.758950 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.770220 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.781346 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.792297 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.803449 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.814698 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:02.825960 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:36:02.948684 tst ping.py:19: start network... 05:36:03.174553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:03.687402 run create_hlr_db(pid=12438): Launched 05:36:03.821489 bus /gobi_6: Setting Powered False 05:36:04.886673 run create_hlr_db(pid=12438): Terminated: ok {rc=0} 05:36:05.329245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12440): Launched 05:36:05.638799 run osmo-hlr_10.42.42.2(pid=12441): Launched 05:36:05.760603 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:06.291797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12444): Launched 05:36:06.601065 run osmo-stp_10.42.42.5(pid=12445): Launched 05:36:06.719399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:07.251786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12447): Launched 05:36:07.370758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:07.631927 run patchelf(pid=12448): Launched 05:36:07.804277 run osmo-stp_10.42.42.5(pid=12445): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12445)] 05:36:07.935378 run osmo-stp_10.42.42.5(pid=12445): stdout: | (launched: 2022-12-14_05:36:06.544512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:08.067403 run osmo-stp_10.42.42.5(pid=12445): stderr: | 20221214053606716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053606716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053606717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053606717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053606718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053606719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053606719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:08.199907 run osmo-stp_10.42.42.5(pid=12445): stdout: | (launched: 2022-12-14_05:36:06.544512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:08.326031 run osmo-stp_10.42.42.5(pid=12445): stderr: | 20221214053606716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053606716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053606717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053606717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053606718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053606719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053606719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:08.475837 run patchelf(pid=12448): Terminating (SIGINT) 05:36:08.647868 run patchelf(pid=12448): Terminated: ok {rc=0} 05:36:08.772152 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12445): Process ended prematurely: osmo-stp_10.42.42.5(pid=12445) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12445)] [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 05:36:08.781365 tst ping.py:22: Test FAILED (6.6 sec) 05:36:08.808131 run osmo-hlr_10.42.42.2(pid=12441): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12441)] 05:36:08.856252 run osmo-hlr_10.42.42.2(pid=12441): stdout: | (launched: 2022-12-14_05:36:05.581999) 05:36:08.905784 run osmo-hlr_10.42.42.2(pid=12441): stderr: | 20221214053605760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053605760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053605760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053605760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053605760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053605760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053605772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053605780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053605781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053605781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:08.955753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12440): Terminating (SIGTERM) 05:36:08.995704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12444): Terminating (SIGTERM) 05:36:09.035650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12447): Terminating (SIGTERM) 05:36:09.075822 --- ParallelTerminationStrategy: PID 12440 died... 05:36:09.095428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12440): Terminated: ok {rc=0} 05:36:09.140012 --- ParallelTerminationStrategy: PID 12444 died... 05:36:09.159060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12444): Terminated: ok {rc=0} 05:36:09.203291 --- ParallelTerminationStrategy: PID 12447 died... 05:36:09.222373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12447): Terminated: ok {rc=0} 05:36:09.308451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:36:10.399128 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:10.412703 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:36:10.452151 tst ping_idle_ping.py: using LAC 38764 05:36:10.583811 tst ping_idle_ping.py: using RAC 4 05:36:10.713543 tst ping_idle_ping.py: using CellId 38764 05:36:10.843406 tst ping_idle_ping.py: using BVCI 38765 05:36:10.965728 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:10.976904 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:10.988067 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:10.999167 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:11.010292 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:11.021621 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:11.032739 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:36:11.043944 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:36:11.167233 tst ping_idle_ping.py:24: start network... 05:36:11.376772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:11.857116 run create_hlr_db(pid=12449): Launched 05:36:11.976285 bus /gobi_6: Setting Powered False 05:36:13.038210 run create_hlr_db(pid=12449): Terminated: ok {rc=0} 05:36:13.490451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12451): Launched 05:36:13.822848 run osmo-hlr_10.42.42.2(pid=12452): Launched 05:36:13.949237 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:14.519406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12454): Launched 05:36:14.851178 run osmo-stp_10.42.42.5(pid=12455): Launched 05:36:14.977843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:15.551332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12457): Launched 05:36:15.679153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:15.969055 run patchelf(pid=12458): Launched 05:36:16.185432 run osmo-stp_10.42.42.5(pid=12455): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12455)] 05:36:16.327823 run osmo-stp_10.42.42.5(pid=12455): stdout: | (launched: 2022-12-14_05:36:14.791135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:16.471875 run osmo-stp_10.42.42.5(pid=12455): stderr: | 20221214053614984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053614984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053614984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053614984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053614985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053614985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053614985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:16.616679 run osmo-stp_10.42.42.5(pid=12455): stdout: | (launched: 2022-12-14_05:36:14.791135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:16.755067 run osmo-stp_10.42.42.5(pid=12455): stderr: | 20221214053614984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053614984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053614984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053614984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053614985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053614985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053614985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:16.942705 run patchelf(pid=12458): Terminating (SIGINT) 05:36:17.158914 run patchelf(pid=12458): Terminated: ok {rc=0} 05:36:17.287708 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12455): Process ended prematurely: osmo-stp_10.42.42.5(pid=12455) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12455)] [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 05:36:17.297194 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 05:36:17.324148 run osmo-hlr_10.42.42.2(pid=12452): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12452)] 05:36:17.372732 run osmo-hlr_10.42.42.2(pid=12452): stdout: | (launched: 2022-12-14_05:36:13.762299) 05:36:17.422931 run osmo-hlr_10.42.42.2(pid=12452): stderr: | 20221214053613962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053613962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053613962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053613962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053613962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053613962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053613975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053613983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053613983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053613983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:17.473327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12451): Terminating (SIGTERM) 05:36:17.513687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12454): Terminating (SIGTERM) 05:36:17.554525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12457): Terminating (SIGTERM) 05:36:17.595370 --- ParallelTerminationStrategy: PID 12451 died... 05:36:17.615228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12451): Terminated: ok {rc=0} 05:36:17.660304 --- ParallelTerminationStrategy: PID 12454 died... 05:36:17.679651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12454): Terminated: ok {rc=0} 05:36:17.724739 --- ParallelTerminationStrategy: PID 12457 died... 05:36:17.744138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12457): Terminated: ok {rc=0} 05:36:17.832242 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:36:19.118920 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:36:19.125034 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:36:19.145624 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:36:19.184836 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:36:19.271197 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:36:19.291762 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:36:19.329994 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:36:19.923381 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:36:19.974194 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:19.984924 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:20.043887 tst cs_paging_gprs_active.py: using LAC 38765 05:36:20.166124 tst cs_paging_gprs_active.py: using RAC 5 05:36:20.289381 tst cs_paging_gprs_active.py: using CellId 38765 05:36:20.411092 tst cs_paging_gprs_active.py: using BVCI 38766 05:36:20.526801 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.537862 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.548497 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.559176 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.570030 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.581322 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.592712 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.603552 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.614619 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:20.736456 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:20.856659 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:36:21.070092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:21.386869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12462): Launched 05:36:21.660632 run iperf3-srv_10.42.42.10(pid=12463): Launched 05:36:21.778880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:36:21.990706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:22.305978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12464): Launched 05:36:22.581288 run iperf3-srv_10.42.42.10(pid=12465): Launched 05:36:22.699528 tst cs_paging_gprs_active.py:38: start network... 05:36:22.910073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:23.396467 run create_hlr_db(pid=12466): Launched 05:36:23.515913 bus /gobi_6: Setting Powered False 05:36:24.578632 run create_hlr_db(pid=12466): Terminated: ok {rc=0} 05:36:25.038022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12468): Launched 05:36:25.375025 run osmo-hlr_10.42.42.2(pid=12469): Launched 05:36:25.503976 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:26.083878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12471): Launched 05:36:26.420167 run osmo-stp_10.42.42.5(pid=12472): Launched 05:36:26.548422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:27.129877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12474): Launched 05:36:27.258321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:27.542952 run patchelf(pid=12475): Launched 05:36:27.729586 run osmo-stp_10.42.42.5(pid=12472): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12472)] 05:36:27.871850 run osmo-stp_10.42.42.5(pid=12472): stdout: | (launched: 2022-12-14_05:36:26.359194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:28.016372 run osmo-stp_10.42.42.5(pid=12472): stderr: | 20221214053626553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053626553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053626553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053626554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053626554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053626554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053626554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:28.161066 run osmo-stp_10.42.42.5(pid=12472): stdout: | (launched: 2022-12-14_05:36:26.359194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:28.298093 run osmo-stp_10.42.42.5(pid=12472): stderr: | 20221214053626553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053626553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053626553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053626554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053626554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053626554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053626554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:28.461084 run patchelf(pid=12475): Terminating (SIGINT) 05:36:28.649067 run patchelf(pid=12475): Terminated: ok {rc=0} 05:36:28.784828 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12472): Process ended prematurely: osmo-stp_10.42.42.5(pid=12472) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12472)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:36:28.794995 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:36:28.823547 run osmo-hlr_10.42.42.2(pid=12469): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12469)] 05:36:28.873810 run osmo-hlr_10.42.42.2(pid=12469): stdout: | (launched: 2022-12-14_05:36:25.313846) 05:36:28.925678 run osmo-hlr_10.42.42.2(pid=12469): stderr: | 20221214053625512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053625512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053625512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053625512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053625512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053625513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053625524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053625533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053625533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053625533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:28.978133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12462): Terminating (SIGTERM) 05:36:29.020113 run iperf3-srv_10.42.42.10(pid=12463): Terminating (SIGTERM) 05:36:29.062263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12464): Terminating (SIGTERM) 05:36:29.104219 run iperf3-srv_10.42.42.10(pid=12465): Terminating (SIGTERM) 05:36:29.146208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12468): Terminating (SIGTERM) 05:36:29.188159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12471): Terminating (SIGTERM) 05:36:29.230007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12474): Terminating (SIGTERM) 05:36:29.271997 --- ParallelTerminationStrategy: PID 12462 died... 05:36:29.291972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12462): Terminated: ok {rc=0} 05:36:29.338206 --- ParallelTerminationStrategy: PID 12463 died... 05:36:29.357802 run iperf3-srv_10.42.42.10(pid=12463): Terminated {rc=256} 05:36:29.403589 --- ParallelTerminationStrategy: PID 12464 died... 05:36:29.423193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12464): Terminated: ok {rc=0} 05:36:29.469164 --- ParallelTerminationStrategy: PID 12465 died... 05:36:29.488569 run iperf3-srv_10.42.42.10(pid=12465): Terminated {rc=256} 05:36:29.534406 --- ParallelTerminationStrategy: PID 12468 died... 05:36:29.554032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12468): Terminated: ok {rc=0} 05:36:29.600058 --- ParallelTerminationStrategy: PID 12471 died... 05:36:29.619624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12471): Terminated: ok {rc=0} 05:36:29.665474 --- ParallelTerminationStrategy: PID 12474 died... 05:36:29.685093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12474): Terminated: ok {rc=0} 05:36:29.773335 bus /gobi_0: Setting Powered False 05:36:30.882034 bus /gobi_0: Setting Powered False 05:36:32.017854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:36:33.163532 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.175177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:33.234366 tst iperf3.py: using LAC 38766 05:36:33.358720 tst iperf3.py: using RAC 6 05:36:33.482780 tst iperf3.py: using CellId 38766 05:36:33.607518 tst iperf3.py: using BVCI 38767 05:36:33.722944 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.733945 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.744535 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.755245 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.766171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.777595 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.788678 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.799568 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:33.810638 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:33.927268 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:36:34.141029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:34.458631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12476): Launched 05:36:34.735280 run iperf3-srv_10.42.42.10(pid=12477): Launched 05:36:34.853496 tst iperf3.py:8: start network... 05:36:35.065169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:35.552242 run create_hlr_db(pid=12478): Launched 05:36:35.673391 bus /gobi_6: Setting Powered False 05:36:36.735789 run create_hlr_db(pid=12478): Terminated: ok {rc=0} 05:36:37.195075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12480): Launched 05:36:37.533140 run osmo-hlr_10.42.42.2(pid=12481): Launched 05:36:37.662047 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:38.241990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12483): Launched 05:36:38.577397 run osmo-stp_10.42.42.5(pid=12484): Launched 05:36:38.707328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:39.286923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12486): Launched 05:36:39.417107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:39.701753 run patchelf(pid=12487): Launched 05:36:39.888178 run osmo-stp_10.42.42.5(pid=12484): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12484)] 05:36:40.030455 run osmo-stp_10.42.42.5(pid=12484): stdout: | (launched: 2022-12-14_05:36:38.516243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:40.174476 run osmo-stp_10.42.42.5(pid=12484): stderr: | 20221214053638710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053638711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053638711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053638711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053638712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053638712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053638712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:40.317934 run osmo-stp_10.42.42.5(pid=12484): stdout: | (launched: 2022-12-14_05:36:38.516243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:40.455075 run osmo-stp_10.42.42.5(pid=12484): stderr: | 20221214053638710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053638711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053638711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053638711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053638712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053638712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053638712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:40.617643 run patchelf(pid=12487): Terminating (SIGINT) 05:36:40.805379 run patchelf(pid=12487): Terminated: ok {rc=0} 05:36:40.940704 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12484): Process ended prematurely: osmo-stp_10.42.42.5(pid=12484) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12484)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 05:36:40.950977 tst iperf3.py:8: Test FAILED (7.8 sec) 05:36:40.979799 run osmo-hlr_10.42.42.2(pid=12481): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12481)] 05:36:41.030318 run osmo-hlr_10.42.42.2(pid=12481): stdout: | (launched: 2022-12-14_05:36:37.471946) 05:36:41.083110 run osmo-hlr_10.42.42.2(pid=12481): stderr: | 20221214053637672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053637672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053637672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053637672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053637672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053637672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053637689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053637699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053637699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053637699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:41.135836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12476): Terminating (SIGTERM) 05:36:41.178129 run iperf3-srv_10.42.42.10(pid=12477): Terminating (SIGTERM) 05:36:41.220338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12480): Terminating (SIGTERM) 05:36:41.263266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12483): Terminating (SIGTERM) 05:36:41.305510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12486): Terminating (SIGTERM) 05:36:41.348534 --- ParallelTerminationStrategy: PID 12476 died... 05:36:41.368908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12476): Terminated: ok {rc=0} 05:36:41.415657 --- ParallelTerminationStrategy: PID 12477 died... 05:36:41.435511 run iperf3-srv_10.42.42.10(pid=12477): Terminated {rc=256} 05:36:41.481793 --- ParallelTerminationStrategy: PID 12480 died... 05:36:41.501617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12480): Terminated: ok {rc=0} 05:36:41.548365 --- ParallelTerminationStrategy: PID 12483 died... 05:36:41.568227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12483): Terminated: ok {rc=0} 05:36:41.614825 --- ParallelTerminationStrategy: PID 12486 died... 05:36:41.634692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12486): Terminated: ok {rc=0} 05:36:41.723413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:36:42.875599 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:42.887613 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:42.945512 tst iperf3m4.py: using LAC 38767 05:36:43.070189 tst iperf3m4.py: using RAC 7 05:36:43.194848 tst iperf3m4.py: using CellId 38767 05:36:43.319326 tst iperf3m4.py: using BVCI 38768 05:36:43.442885 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.454526 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.465900 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.477248 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.488327 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.499734 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.511173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.522343 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:43.533697 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:43.655422 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:43.776432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:43.897936 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:44.015938 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:36:44.229310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:44.546370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12488): Launched 05:36:44.823143 run iperf3-srv_10.42.42.10(pid=12489): Launched 05:36:44.941343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:36:45.153388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:45.469762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12490): Launched 05:36:45.743830 run iperf3-srv_10.42.42.10(pid=12491): Launched 05:36:45.874380 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:36:46.108407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:46.455180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12492): Launched 05:36:46.768096 run iperf3-srv_10.42.42.10(pid=12493): Launched 05:36:46.897064 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:36:47.113916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:47.434905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12494): Launched 05:36:47.710171 run iperf3-srv_10.42.42.10(pid=12495): Launched 05:36:47.828341 tst iperf3m4.py:8: start network... 05:36:48.039675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:48.528569 run create_hlr_db(pid=12496): Launched 05:36:48.648112 bus /gobi_6: Setting Powered False 05:36:49.709728 run create_hlr_db(pid=12496): Terminated: ok {rc=0} 05:36:50.168773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Launched 05:36:50.505343 run osmo-hlr_10.42.42.2(pid=12499): Launched 05:36:50.633728 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:51.211671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Launched 05:36:51.548395 run osmo-stp_10.42.42.5(pid=12502): Launched 05:36:51.675929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:52.257253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12504): Launched 05:36:52.387132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:52.671139 run patchelf(pid=12505): Launched 05:36:52.857492 run osmo-stp_10.42.42.5(pid=12502): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] 05:36:52.999308 run osmo-stp_10.42.42.5(pid=12502): stdout: | (launched: 2022-12-14_05:36:51.487102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:53.143302 run osmo-stp_10.42.42.5(pid=12502): stderr: | 20221214053651678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053651678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053651679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053651679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053651679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053651680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053651680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:53.286523 run osmo-stp_10.42.42.5(pid=12502): stdout: | (launched: 2022-12-14_05:36:51.487102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:53.423691 run osmo-stp_10.42.42.5(pid=12502): stderr: | 20221214053651678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053651678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053651679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053651679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053651679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053651680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053651680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:53.586357 run patchelf(pid=12505): Terminating (SIGINT) 05:36:53.773658 run patchelf(pid=12505): Terminated: ok {rc=0} 05:36:53.908910 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12502): Process ended prematurely: osmo-stp_10.42.42.5(pid=12502) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:36:53.919245 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:36:53.947933 run osmo-hlr_10.42.42.2(pid=12499): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12499)] 05:36:53.998247 run osmo-hlr_10.42.42.2(pid=12499): stdout: | (launched: 2022-12-14_05:36:50.444175) 05:36:54.050681 run osmo-hlr_10.42.42.2(pid=12499): stderr: | 20221214053650643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053650643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053650643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053650643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053650643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053650643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053650664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053650674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053650674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053650674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:54.103710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12488): Terminating (SIGTERM) 05:36:54.146248 run iperf3-srv_10.42.42.10(pid=12489): Terminating (SIGTERM) 05:36:54.188570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12490): Terminating (SIGTERM) 05:36:54.230997 run iperf3-srv_10.42.42.10(pid=12491): Terminating (SIGTERM) 05:36:54.273148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12492): Terminating (SIGTERM) 05:36:54.315472 run iperf3-srv_10.42.42.10(pid=12493): Terminating (SIGTERM) 05:36:54.357665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12494): Terminating (SIGTERM) 05:36:54.400184 run iperf3-srv_10.42.42.10(pid=12495): Terminating (SIGTERM) 05:36:54.442746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Terminating (SIGTERM) 05:36:54.484704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Terminating (SIGTERM) 05:36:54.526758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12504): Terminating (SIGTERM) 05:36:54.569094 --- ParallelTerminationStrategy: PID 12488 died... 05:36:54.589404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12488): Terminated: ok {rc=0} 05:36:54.636016 --- ParallelTerminationStrategy: PID 12489 died... 05:36:54.655734 run iperf3-srv_10.42.42.10(pid=12489): Terminated {rc=256} 05:36:54.702077 --- ParallelTerminationStrategy: PID 12490 died... 05:36:54.721992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12490): Terminated: ok {rc=0} 05:36:54.768400 --- ParallelTerminationStrategy: PID 12491 died... 05:36:54.788157 run iperf3-srv_10.42.42.10(pid=12491): Terminated {rc=256} 05:36:54.834415 --- ParallelTerminationStrategy: PID 12492 died... 05:36:54.854049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12492): Terminated: ok {rc=0} 05:36:54.900387 --- ParallelTerminationStrategy: PID 12493 died... 05:36:54.920047 run iperf3-srv_10.42.42.10(pid=12493): Terminated {rc=256} 05:36:54.966224 --- ParallelTerminationStrategy: PID 12494 died... 05:36:54.985978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12494): Terminated: ok {rc=0} 05:36:55.032219 --- ParallelTerminationStrategy: PID 12495 died... 05:36:55.052286 run iperf3-srv_10.42.42.10(pid=12495): Terminated {rc=256} 05:36:55.098847 --- ParallelTerminationStrategy: PID 12498 died... 05:36:55.118837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Terminated: ok {rc=0} 05:36:55.165571 --- ParallelTerminationStrategy: PID 12501 died... 05:36:55.185480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Terminated: ok {rc=0} 05:36:55.232038 --- ParallelTerminationStrategy: PID 12504 died... 05:36:55.251867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12504): Terminated: ok {rc=0} 05:36:55.341012 bus /gobi_4: Setting Powered False 05:36:56.440704 bus /gobi_4: Setting Powered False 05:36:57.557397 bus /gobi_1: Setting Powered False 05:36:58.656916 bus /gobi_1: Setting Powered False 05:36:59.773607 bus /gobi_0: Setting Powered False 05:37:00.875421 bus /gobi_0: Setting Powered False 05:37:02.022718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:37:03.139979 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.152031 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:37:03.211025 tst ping.py: using LAC 38768 05:37:03.344288 tst ping.py: using RAC 8 05:37:03.474845 tst ping.py: using CellId 38768 05:37:03.602990 tst ping.py: using BVCI 38769 05:37:03.723982 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.735370 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.746499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.757695 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.768719 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.779870 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.791221 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:03.802330 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:37:03.923178 tst ping.py:19: start network... 05:37:04.147217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:04.658674 run create_hlr_db(pid=12506): Launched 05:37:04.793334 bus /gobi_6: Setting Powered False 05:37:05.858807 run create_hlr_db(pid=12506): Terminated: ok {rc=0} 05:37:06.301144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12508): Launched 05:37:06.611358 run osmo-hlr_10.42.42.2(pid=12509): Launched 05:37:06.730134 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:07.271267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12511): Launched 05:37:07.581153 run osmo-stp_10.42.42.5(pid=12512): Launched 05:37:07.700175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:08.232703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12514): Launched 05:37:08.351242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:08.612057 run patchelf(pid=12515): Launched 05:37:08.783379 run osmo-stp_10.42.42.5(pid=12512): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12512)] 05:37:08.914443 run osmo-stp_10.42.42.5(pid=12512): stdout: | (launched: 2022-12-14_05:37:07.524361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:09.047167 run osmo-stp_10.42.42.5(pid=12512): stderr: | 20221214053707695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053707695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053707695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053707696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053707696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053707696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053707697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:09.179693 run osmo-stp_10.42.42.5(pid=12512): stdout: | (launched: 2022-12-14_05:37:07.524361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:09.305841 run osmo-stp_10.42.42.5(pid=12512): stderr: | 20221214053707695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053707695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053707695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053707696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053707696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053707696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053707697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:09.455407 run patchelf(pid=12515): Terminating (SIGINT) 05:37:09.627548 run patchelf(pid=12515): Terminated: ok {rc=0} 05:37:09.751918 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12512): Process ended prematurely: osmo-stp_10.42.42.5(pid=12512) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12512)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 05:37:09.760911 tst ping.py:22: Test FAILED (6.6 sec) 05:37:09.787647 run osmo-hlr_10.42.42.2(pid=12509): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12509)] 05:37:09.835479 run osmo-hlr_10.42.42.2(pid=12509): stdout: | (launched: 2022-12-14_05:37:06.554779) 05:37:09.885171 run osmo-hlr_10.42.42.2(pid=12509): stderr: | 20221214053706730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053706730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053706730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053706730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053706730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053706730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053706742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053706750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053706750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053706751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:09.934943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12508): Terminating (SIGTERM) 05:37:09.974935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12511): Terminating (SIGTERM) 05:37:10.014819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12514): Terminating (SIGTERM) 05:37:10.054962 --- ParallelTerminationStrategy: PID 12508 died... 05:37:10.074204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12508): Terminated: ok {rc=0} 05:37:10.118390 --- ParallelTerminationStrategy: PID 12511 died... 05:37:10.137636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12511): Terminated: ok {rc=0} 05:37:10.181482 --- ParallelTerminationStrategy: PID 12514 died... 05:37:10.200328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12514): Terminated: ok {rc=0} 05:37:10.285834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:37:11.373441 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:11.385592 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:37:11.444534 tst ping_idle_ping.py: using LAC 38769 05:37:11.575998 tst ping_idle_ping.py: using RAC 9 05:37:11.707347 tst ping_idle_ping.py: using CellId 38769 05:37:11.838855 tst ping_idle_ping.py: using BVCI 38770 05:37:11.959271 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:11.970905 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:11.982032 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:11.993115 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:12.004139 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:12.015099 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:12.026356 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:37:12.037463 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:37:12.154627 tst ping_idle_ping.py:24: start network... 05:37:12.365100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:12.848647 run create_hlr_db(pid=12516): Launched 05:37:12.967316 bus /gobi_6: Setting Powered False 05:37:14.029428 run create_hlr_db(pid=12516): Terminated: ok {rc=0} 05:37:14.483206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12518): Launched 05:37:14.818092 run osmo-hlr_10.42.42.2(pid=12519): Launched 05:37:14.946930 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:15.521304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12521): Launched 05:37:15.858367 run osmo-stp_10.42.42.5(pid=12522): Launched 05:37:16.126512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:16.798531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12524): Launched 05:37:16.927476 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:17.212808 run patchelf(pid=12525): Launched 05:37:17.403153 run osmo-stp_10.42.42.5(pid=12522): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12522)] 05:37:17.536417 run osmo-stp_10.42.42.5(pid=12522): stdout: | (launched: 2022-12-14_05:37:15.792510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:17.671195 run osmo-stp_10.42.42.5(pid=12522): stderr: | 20221214053716027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053716027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053716028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053716028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053716029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053716029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053716029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:17.805913 run osmo-stp_10.42.42.5(pid=12522): stdout: | (launched: 2022-12-14_05:37:15.792510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:17.933706 run osmo-stp_10.42.42.5(pid=12522): stderr: | 20221214053716027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053716027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053716028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053716028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053716029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053716029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053716029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:18.084641 run patchelf(pid=12525): Terminating (SIGINT) 05:37:18.259158 run patchelf(pid=12525): Terminated: ok {rc=0} 05:37:18.385727 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12522): Process ended prematurely: osmo-stp_10.42.42.5(pid=12522) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12522)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:37:18.394864 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 05:37:18.421784 run osmo-hlr_10.42.42.2(pid=12519): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12519)] 05:37:18.470514 run osmo-hlr_10.42.42.2(pid=12519): stdout: | (launched: 2022-12-14_05:37:14.757773) 05:37:18.520925 run osmo-hlr_10.42.42.2(pid=12519): stderr: | 20221214053714958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053714958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053714958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053714958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053714958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053714958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053714970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053714979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053714979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053714979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:18.571705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12518): Terminating (SIGTERM) 05:37:18.612686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12521): Terminating (SIGTERM) 05:37:18.653718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12524): Terminating (SIGTERM) 05:37:18.694922 --- ParallelTerminationStrategy: PID 12518 died... 05:37:18.714812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12518): Terminated: ok {rc=0} 05:37:18.759876 --- ParallelTerminationStrategy: PID 12521 died... 05:37:18.779275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12521): Terminated: ok {rc=0} 05:37:18.824322 --- ParallelTerminationStrategy: PID 12524 died... 05:37:18.843837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12524): Terminated: ok {rc=0} 05:37:18.931535 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:37:20.216498 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:37:20.222514 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:37:20.242933 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:37:20.281643 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:37:20.368538 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:37:20.389207 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:37:20.427248 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:37:21.021350 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:37:21.072658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.083746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:21.141437 tst cs_paging_gprs_active.py: using LAC 38770 05:37:21.273833 tst cs_paging_gprs_active.py: using RAC 10 05:37:21.406894 tst cs_paging_gprs_active.py: using CellId 38770 05:37:21.539888 tst cs_paging_gprs_active.py: using BVCI 38771 05:37:21.658268 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.669280 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.679968 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.690780 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.701792 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.713382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.724339 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.735239 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.746254 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:21.868091 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:21.988067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:37:22.201680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:22.518702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Launched 05:37:22.792797 run iperf3-srv_10.42.42.10(pid=12531): Launched 05:37:22.911051 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:37:23.123107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:23.439038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12532): Launched 05:37:23.713245 run iperf3-srv_10.42.42.10(pid=12533): Launched 05:37:23.831439 tst cs_paging_gprs_active.py:38: start network... 05:37:24.042841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:24.530877 run create_hlr_db(pid=12534): Launched 05:37:24.650356 bus /gobi_6: Setting Powered False 05:37:25.712441 run create_hlr_db(pid=12534): Terminated: ok {rc=0} 05:37:26.171273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12536): Launched 05:37:26.510414 run osmo-hlr_10.42.42.2(pid=12537): Launched 05:37:26.641367 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:27.225951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12539): Launched 05:37:27.562276 run osmo-stp_10.42.42.5(pid=12540): Launched 05:37:27.692856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:28.273285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12542): Launched 05:37:28.402371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:28.687220 run patchelf(pid=12543): Launched 05:37:28.873975 run osmo-stp_10.42.42.5(pid=12540): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12540)] 05:37:29.016672 run osmo-stp_10.42.42.5(pid=12540): stdout: | (launched: 2022-12-14_05:37:27.501147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:29.161407 run osmo-stp_10.42.42.5(pid=12540): stderr: | 20221214053727693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053727693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053727694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053727694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053727694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053727695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053727695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:29.305425 run osmo-stp_10.42.42.5(pid=12540): stdout: | (launched: 2022-12-14_05:37:27.501147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:29.443211 run osmo-stp_10.42.42.5(pid=12540): stderr: | 20221214053727693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053727693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053727694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053727694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053727694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053727695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053727695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:29.606521 run patchelf(pid=12543): Terminating (SIGINT) 05:37:29.794639 run patchelf(pid=12543): Terminated: ok {rc=0} 05:37:29.930329 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12540): Process ended prematurely: osmo-stp_10.42.42.5(pid=12540) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12540)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:37:29.940662 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:37:29.969580 run osmo-hlr_10.42.42.2(pid=12537): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12537)] 05:37:30.020123 run osmo-hlr_10.42.42.2(pid=12537): stdout: | (launched: 2022-12-14_05:37:26.449269) 05:37:30.072750 run osmo-hlr_10.42.42.2(pid=12537): stderr: | 20221214053726649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053726649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053726649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053726649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053726649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053726649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053726661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053726671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053726671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053726671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:30.125577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Terminating (SIGTERM) 05:37:30.167807 run iperf3-srv_10.42.42.10(pid=12531): Terminating (SIGTERM) 05:37:30.209988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12532): Terminating (SIGTERM) 05:37:30.252353 run iperf3-srv_10.42.42.10(pid=12533): Terminating (SIGTERM) 05:37:30.294533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12536): Terminating (SIGTERM) 05:37:30.336734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12539): Terminating (SIGTERM) 05:37:30.379183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12542): Terminating (SIGTERM) 05:37:30.422474 --- ParallelTerminationStrategy: PID 12530 died... 05:37:30.442675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Terminated: ok {rc=0} 05:37:30.489588 --- ParallelTerminationStrategy: PID 12531 died... 05:37:30.509336 run iperf3-srv_10.42.42.10(pid=12531): Terminated {rc=256} 05:37:30.555806 --- ParallelTerminationStrategy: PID 12532 died... 05:37:30.575701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12532): Terminated: ok {rc=0} 05:37:30.622339 --- ParallelTerminationStrategy: PID 12533 died... 05:37:30.642258 run iperf3-srv_10.42.42.10(pid=12533): Terminated {rc=256} 05:37:30.688695 --- ParallelTerminationStrategy: PID 12536 died... 05:37:30.708686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12536): Terminated: ok {rc=0} 05:37:30.755362 --- ParallelTerminationStrategy: PID 12539 died... 05:37:30.775439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12539): Terminated: ok {rc=0} 05:37:30.822125 --- ParallelTerminationStrategy: PID 12542 died... 05:37:30.848115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12542): Terminated: ok {rc=0} 05:37:30.954598 bus /gobi_0: Setting Powered False 05:37:32.055797 bus /gobi_0: Setting Powered False 05:37:33.174120 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:37:34.325320 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.340281 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:34.401262 tst iperf3.py: using LAC 38771 05:37:34.530093 tst iperf3.py: using RAC 11 05:37:34.653775 tst iperf3.py: using CellId 38771 05:37:34.778156 tst iperf3.py: using BVCI 38772 05:37:34.894944 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.906152 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.916798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.927540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.938623 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.949647 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.960731 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.971624 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:34.982746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:35.104031 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:37:35.332928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:35.672401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12544): Launched 05:37:35.965662 run iperf3-srv_10.42.42.10(pid=12545): Launched 05:37:36.091752 tst iperf3.py:8: start network... 05:37:36.319147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:36.840706 run create_hlr_db(pid=12546): Launched 05:37:36.977525 bus /gobi_6: Setting Powered False 05:37:38.043663 run create_hlr_db(pid=12546): Terminated: ok {rc=0} 05:37:38.494141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12548): Launched 05:37:38.810339 run osmo-hlr_10.42.42.2(pid=12549): Launched 05:37:38.930566 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:39.513495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12551): Launched 05:37:39.849280 run osmo-stp_10.42.42.5(pid=12552): Launched 05:37:39.978690 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:40.561980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12554): Launched 05:37:40.691594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:40.977640 run patchelf(pid=12555): Launched 05:37:41.164904 run osmo-stp_10.42.42.5(pid=12552): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12552)] 05:37:41.307076 run osmo-stp_10.42.42.5(pid=12552): stdout: | (launched: 2022-12-14_05:37:39.788130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:41.451229 run osmo-stp_10.42.42.5(pid=12552): stderr: | 20221214053739983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053739984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053739984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053739984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053739985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053739985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053739985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:41.595022 run osmo-stp_10.42.42.5(pid=12552): stdout: | (launched: 2022-12-14_05:37:39.788130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:41.732278 run osmo-stp_10.42.42.5(pid=12552): stderr: | 20221214053739983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053739984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053739984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053739984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053739985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053739985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053739985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:41.895233 run patchelf(pid=12555): Terminating (SIGINT) 05:37:42.083576 run patchelf(pid=12555): Terminated: ok {rc=0} 05:37:42.219721 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12552): Process ended prematurely: osmo-stp_10.42.42.5(pid=12552) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12552)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 05:37:42.230060 tst iperf3.py:8: Test FAILED (7.9 sec) 05:37:42.258889 run osmo-hlr_10.42.42.2(pid=12549): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12549)] 05:37:42.309539 run osmo-hlr_10.42.42.2(pid=12549): stdout: | (launched: 2022-12-14_05:37:38.752901) 05:37:42.362109 run osmo-hlr_10.42.42.2(pid=12549): stderr: | 20221214053738931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053738931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053738931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053738931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053738931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053738931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053738943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053738952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053738952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053738952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:42.414934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12544): Terminating (SIGTERM) 05:37:42.457511 run iperf3-srv_10.42.42.10(pid=12545): Terminating (SIGTERM) 05:37:42.500730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12548): Terminating (SIGTERM) 05:37:42.543719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12551): Terminating (SIGTERM) 05:37:42.586187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12554): Terminating (SIGTERM) 05:37:42.629241 --- ParallelTerminationStrategy: PID 12544 died... 05:37:42.649554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12544): Terminated: ok {rc=0} 05:37:42.696427 --- ParallelTerminationStrategy: PID 12545 died... 05:37:42.716448 run iperf3-srv_10.42.42.10(pid=12545): Terminated {rc=256} 05:37:42.762808 --- ParallelTerminationStrategy: PID 12548 died... 05:37:42.782606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12548): Terminated: ok {rc=0} 05:37:42.829152 --- ParallelTerminationStrategy: PID 12551 died... 05:37:42.848925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12551): Terminated: ok {rc=0} 05:37:42.895413 --- ParallelTerminationStrategy: PID 12554 died... 05:37:42.915260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12554): Terminated: ok {rc=0} 05:37:43.004355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:37:44.156899 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.169475 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:44.227147 tst iperf3m4.py: using LAC 38772 05:37:44.358524 tst iperf3m4.py: using RAC 12 05:37:44.491532 tst iperf3m4.py: using CellId 38772 05:37:44.621084 tst iperf3m4.py: using BVCI 38773 05:37:44.742778 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.754356 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.765739 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.776798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.787913 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.799141 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.810435 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.821516 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:44.832696 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:44.952491 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:45.072649 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:45.192142 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:45.315074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:37:45.542816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:45.885213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12557): Launched 05:37:46.228222 run iperf3-srv_10.42.42.10(pid=12558): Launched 05:37:46.367516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:37:46.588055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:46.914943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12559): Launched 05:37:47.208703 run iperf3-srv_10.42.42.10(pid=12560): Launched 05:37:47.334100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:37:47.560704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:47.897518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12561): Launched 05:37:48.190423 run iperf3-srv_10.42.42.10(pid=12562): Launched 05:37:48.317489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:37:48.544532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:48.882183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12563): Launched 05:37:49.175819 run iperf3-srv_10.42.42.10(pid=12564): Launched 05:37:49.301173 tst iperf3m4.py:8: start network... 05:37:49.527796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:50.047788 run create_hlr_db(pid=12565): Launched 05:37:50.185149 bus /gobi_6: Setting Powered False 05:37:51.250883 run create_hlr_db(pid=12565): Terminated: ok {rc=0} 05:37:51.717515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12567): Launched 05:37:52.053466 run osmo-hlr_10.42.42.2(pid=12568): Launched 05:37:52.181316 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:52.771767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12570): Launched 05:37:53.108346 run osmo-stp_10.42.42.5(pid=12571): Launched 05:37:53.236323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:53.816054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12573): Launched 05:37:53.946411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:54.232279 run patchelf(pid=12574): Launched 05:37:54.419422 run osmo-stp_10.42.42.5(pid=12571): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12571)] 05:37:54.561454 run osmo-stp_10.42.42.5(pid=12571): stdout: | (launched: 2022-12-14_05:37:53.046845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:54.706009 run osmo-stp_10.42.42.5(pid=12571): stderr: | 20221214053753239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053753239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053753240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053753240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053753241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053753241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053753241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:54.850054 run osmo-stp_10.42.42.5(pid=12571): stdout: | (launched: 2022-12-14_05:37:53.046845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:54.987397 run osmo-stp_10.42.42.5(pid=12571): stderr: | 20221214053753239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053753239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053753240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053753240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053753241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053753241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053753241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:55.151119 run patchelf(pid=12574): Terminating (SIGINT) 05:37:55.338938 run patchelf(pid=12574): Terminated: ok {rc=0} 05:37:55.474819 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12571): Process ended prematurely: osmo-stp_10.42.42.5(pid=12571) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12571)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:37:55.485316 tst iperf3m4.py:8: Test FAILED (11.4 sec) 05:37:55.514225 run osmo-hlr_10.42.42.2(pid=12568): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12568)] 05:37:55.564593 run osmo-hlr_10.42.42.2(pid=12568): stdout: | (launched: 2022-12-14_05:37:51.992078) 05:37:55.616627 run osmo-hlr_10.42.42.2(pid=12568): stderr: | 20221214053752189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053752189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053752189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053752189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053752189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053752189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053752202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053752210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053752211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053752211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:55.669148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12557): Terminating (SIGTERM) 05:37:55.711137 run iperf3-srv_10.42.42.10(pid=12558): Terminating (SIGTERM) 05:37:55.753255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12559): Terminating (SIGTERM) 05:37:55.795389 run iperf3-srv_10.42.42.10(pid=12560): Terminating (SIGTERM) 05:37:55.837368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12561): Terminating (SIGTERM) 05:37:55.879281 run iperf3-srv_10.42.42.10(pid=12562): Terminating (SIGTERM) 05:37:55.921499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12563): Terminating (SIGTERM) 05:37:55.963855 run iperf3-srv_10.42.42.10(pid=12564): Terminating (SIGTERM) 05:37:56.006134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12567): Terminating (SIGTERM) 05:37:56.048651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12570): Terminating (SIGTERM) 05:37:56.091059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12573): Terminating (SIGTERM) 05:37:56.134058 --- ParallelTerminationStrategy: PID 12557 died... 05:37:56.154174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12557): Terminated: ok {rc=0} 05:37:56.200738 --- ParallelTerminationStrategy: PID 12558 died... 05:37:56.220353 run iperf3-srv_10.42.42.10(pid=12558): Terminated {rc=256} 05:37:56.266525 --- ParallelTerminationStrategy: PID 12559 died... 05:37:56.286329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12559): Terminated: ok {rc=0} 05:37:56.332645 --- ParallelTerminationStrategy: PID 12560 died... 05:37:56.352348 run iperf3-srv_10.42.42.10(pid=12560): Terminated {rc=256} 05:37:56.398571 --- ParallelTerminationStrategy: PID 12561 died... 05:37:56.418247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12561): Terminated: ok {rc=0} 05:37:56.464505 --- ParallelTerminationStrategy: PID 12562 died... 05:37:56.484279 run iperf3-srv_10.42.42.10(pid=12562): Terminated {rc=256} 05:37:56.530621 --- ParallelTerminationStrategy: PID 12563 died... 05:37:56.550350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12563): Terminated: ok {rc=0} 05:37:56.596838 --- ParallelTerminationStrategy: PID 12564 died... 05:37:56.616730 run iperf3-srv_10.42.42.10(pid=12564): Terminated {rc=256} 05:37:56.662908 --- ParallelTerminationStrategy: PID 12567 died... 05:37:56.682671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12567): Terminated: ok {rc=0} 05:37:56.728910 --- ParallelTerminationStrategy: PID 12570 died... 05:37:56.748609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12570): Terminated: ok {rc=0} 05:37:56.794672 --- ParallelTerminationStrategy: PID 12573 died... 05:37:56.814385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12573): Terminated: ok {rc=0} 05:37:56.903322 bus /gobi_4: Setting Powered False 05:37:58.002905 bus /gobi_4: Setting Powered False 05:37:59.118157 bus /gobi_1: Setting Powered False 05:38:00.216076 bus /gobi_1: Setting Powered False 05:38:01.339509 bus /gobi_0: Setting Powered False 05:38:02.440050 bus /gobi_0: Setting Powered False 05:38:03.557100 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:38:04.661340 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:04.673853 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:38:04.733381 tst ping.py: using LAC 38773 05:38:04.864222 tst ping.py: using RAC 13 05:38:04.995752 tst ping.py: using CellId 38773 05:38:05.127720 tst ping.py: using BVCI 38774 05:38:05.250077 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.261706 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.272875 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.284086 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.295225 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.306500 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.318031 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:05.329260 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:38:05.448509 tst ping.py:19: start network... 05:38:05.672114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:06.184637 run create_hlr_db(pid=12575): Launched 05:38:06.318597 bus /gobi_6: Setting Powered False 05:38:07.384880 run create_hlr_db(pid=12575): Terminated: ok {rc=0} 05:38:07.826996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12577): Launched 05:38:08.136764 run osmo-hlr_10.42.42.2(pid=12578): Launched 05:38:08.254695 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:08.808720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12580): Launched 05:38:09.118896 run osmo-stp_10.42.42.5(pid=12581): Launched 05:38:09.236907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:38:09.770013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12583): Launched 05:38:09.890151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:38:10.151330 run patchelf(pid=12584): Launched 05:38:10.323336 run osmo-stp_10.42.42.5(pid=12581): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12581)] 05:38:10.454665 run osmo-stp_10.42.42.5(pid=12581): stdout: | (launched: 2022-12-14_05:38:09.061832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:10.587482 run osmo-stp_10.42.42.5(pid=12581): stderr: | 20221214053809235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053809235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053809235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053809236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053809236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053809236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053809236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:10.720489 run osmo-stp_10.42.42.5(pid=12581): stdout: | (launched: 2022-12-14_05:38:09.061832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:10.847552 run osmo-stp_10.42.42.5(pid=12581): stderr: | 20221214053809235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053809235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053809235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053809236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053809236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053809236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053809236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:10.997997 run patchelf(pid=12584): Terminating (SIGINT) 05:38:11.170960 run patchelf(pid=12584): Terminated: ok {rc=0} 05:38:11.295700 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12581): Process ended prematurely: osmo-stp_10.42.42.5(pid=12581) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12581)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 05:38:11.304857 tst ping.py:22: Test FAILED (6.6 sec) 05:38:11.331931 run osmo-hlr_10.42.42.2(pid=12578): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12578)] 05:38:11.380615 run osmo-hlr_10.42.42.2(pid=12578): stdout: | (launched: 2022-12-14_05:38:08.079943) 05:38:11.430611 run osmo-hlr_10.42.42.2(pid=12578): stderr: | 20221214053808254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053808254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053808254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053808254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053808254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053808255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053808267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053808279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053808279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053808279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:11.481208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12577): Terminating (SIGTERM) 05:38:11.521872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12580): Terminating (SIGTERM) 05:38:11.562290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12583): Terminating (SIGTERM) 05:38:11.603018 --- ParallelTerminationStrategy: PID 12577 died... 05:38:11.622683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12577): Terminated: ok {rc=0} 05:38:11.667550 --- ParallelTerminationStrategy: PID 12580 died... 05:38:11.686694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12580): Terminated: ok {rc=0} 05:38:11.731138 --- ParallelTerminationStrategy: PID 12583 died... 05:38:11.750228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12583): Terminated: ok {rc=0} 05:38:11.837726 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:38:12.925706 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:12.937334 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:38:12.994765 tst ping_idle_ping.py: using LAC 38774 05:38:13.118460 tst ping_idle_ping.py: using RAC 14 05:38:13.242229 tst ping_idle_ping.py: using CellId 38774 05:38:13.366696 tst ping_idle_ping.py: using BVCI 38775 05:38:13.479283 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.490327 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.500927 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.511627 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.522641 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.533974 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.545230 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:38:13.556152 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:38:13.674160 tst ping_idle_ping.py:24: start network... 05:38:13.899929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:14.417118 run create_hlr_db(pid=12585): Launched 05:38:14.551322 bus /gobi_6: Setting Powered False 05:38:15.616603 run create_hlr_db(pid=12585): Terminated: ok {rc=0} 05:38:16.099819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Launched 05:38:16.441663 run osmo-hlr_10.42.42.2(pid=12588): Launched 05:38:16.649226 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:17.329771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Launched 05:38:17.669483 run osmo-stp_10.42.42.5(pid=12591): Launched 05:38:17.797180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:38:18.369144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12593): Launched 05:38:18.495566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:38:18.776118 run patchelf(pid=12594): Launched 05:38:18.962237 run osmo-stp_10.42.42.5(pid=12591): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] 05:38:19.102358 run osmo-stp_10.42.42.5(pid=12591): stdout: | (launched: 2022-12-14_05:38:17.609035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:19.244131 run osmo-stp_10.42.42.5(pid=12591): stderr: | 20221214053817801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053817801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053817802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053817802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053817803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053817803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053817803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:19.386100 run osmo-stp_10.42.42.5(pid=12591): stdout: | (launched: 2022-12-14_05:38:17.609035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:19.521516 run osmo-stp_10.42.42.5(pid=12591): stderr: | 20221214053817801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053817801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053817802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053817802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053817803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053817803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053817803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:19.682081 run patchelf(pid=12594): Terminating (SIGINT) 05:38:19.866553 run patchelf(pid=12594): Terminated: ok {rc=0} 05:38:19.999481 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12591): Process ended prematurely: osmo-stp_10.42.42.5(pid=12591) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:38:20.009206 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 05:38:20.037235 run osmo-hlr_10.42.42.2(pid=12588): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12588)] 05:38:20.087637 run osmo-hlr_10.42.42.2(pid=12588): stdout: | (launched: 2022-12-14_05:38:16.380327) 05:38:20.139740 run osmo-hlr_10.42.42.2(pid=12588): stderr: | 20221214053816703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053816703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053816703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053816703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053816703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053816703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053816755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053816769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053816769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053816769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:20.192301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Terminating (SIGTERM) 05:38:20.234404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Terminating (SIGTERM) 05:38:20.276323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12593): Terminating (SIGTERM) 05:38:20.318978 --- ParallelTerminationStrategy: PID 12587 died... 05:38:20.339596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Terminated: ok {rc=0} 05:38:20.386321 --- ParallelTerminationStrategy: PID 12590 died... 05:38:20.406234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Terminated: ok {rc=0} 05:38:20.452711 --- ParallelTerminationStrategy: PID 12593 died... 05:38:20.472733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12593): Terminated: ok {rc=0} 05:38:20.560997 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:38:21.860123 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:21.867255 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:38:21.888481 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:38:21.923715 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:38:21.978387 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:38:21.999223 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:38:22.033613 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:38:22.594766 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:38:22.600557 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:22.613374 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:38:22.668359 tst switch_tch_pdch.py: using LAC 38775 05:38:22.788628 tst switch_tch_pdch.py: using RAC 15 05:38:22.908626 tst switch_tch_pdch.py: using CellId 38775 05:38:23.031656 tst switch_tch_pdch.py: using BVCI 38776 05:38:23.145986 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.157453 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.168353 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.179320 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.190508 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.201800 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.213231 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:23.224486 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:38:23.347664 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:38:23.467187 tst switch_tch_pdch.py:51: start network... 05:38:23.675683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:24.154560 run create_hlr_db(pid=12599): Launched 05:38:24.272010 bus /gobi_6: Setting Powered False 05:38:25.333860 run create_hlr_db(pid=12599): Terminated: ok {rc=0} 05:38:25.784919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Launched 05:38:26.115269 run osmo-hlr_10.42.42.2(pid=12602): Launched 05:38:26.243181 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:26.812370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Launched 05:38:27.143098 run osmo-stp_10.42.42.5(pid=12605): Launched 05:38:27.269602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:38:27.839689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12607): Launched 05:38:27.965760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:38:28.245430 run patchelf(pid=12608): Launched 05:38:28.428341 run osmo-stp_10.42.42.5(pid=12605): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] 05:38:28.567824 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-14_05:38:27.082801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:28.708626 run osmo-stp_10.42.42.5(pid=12605): stderr: | 20221214053827275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053827275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053827275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053827275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053827276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053827276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053827276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:28.849659 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-14_05:38:27.082801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:28.984806 run osmo-stp_10.42.42.5(pid=12605): stderr: | 20221214053827275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053827275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053827275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053827275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053827276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053827276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053827276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:29.145535 run patchelf(pid=12608): Terminating (SIGINT) 05:38:29.329954 run patchelf(pid=12608): Terminated: ok {rc=0} 05:38:29.463135 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2400↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] [trial-2400↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:38:29.472670 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 05:38:29.501045 run osmo-hlr_10.42.42.2(pid=12602): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12602)] 05:38:29.551766 run osmo-hlr_10.42.42.2(pid=12602): stdout: | (launched: 2022-12-14_05:38:26.054980) 05:38:29.604089 run osmo-hlr_10.42.42.2(pid=12602): stderr: | 20221214053826253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053826253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053826253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053826253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053826253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053826253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053826266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053826274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053826275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053826275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:29.657100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminating (SIGTERM) 05:38:29.699586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminating (SIGTERM) 05:38:29.742289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12607): Terminating (SIGTERM) 05:38:29.785641 --- ParallelTerminationStrategy: PID 12601 died... 05:38:29.805988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminated: ok {rc=0} 05:38:29.852712 --- ParallelTerminationStrategy: PID 12604 died... 05:38:29.872653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminated: ok {rc=0} 05:38:29.919272 --- ParallelTerminationStrategy: PID 12607 died... 05:38:29.939163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12607): Terminated: ok {rc=0} 05:38:30.027564 bus /gobi_0: Setting Powered False 05:38:31.133199 bus /gobi_0: Setting Powered False 05:38:32.261656 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:38:33.496439 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:33.502319 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:38:33.522700 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:38:33.557998 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:38:33.609860 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:38:33.630478 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:38:33.665597 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:38:34.219311 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:38:34.224663 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.235772 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:38:34.294039 tst switch_tch_pdch.py: using LAC 38776 05:38:34.415303 tst switch_tch_pdch.py: using RAC 16 05:38:34.547052 tst switch_tch_pdch.py: using CellId 38776 05:38:34.678703 tst switch_tch_pdch.py: using BVCI 38777 05:38:34.801201 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.812795 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.824450 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.835644 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.846762 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.857908 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.869306 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:34.880492 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:38:34.998412 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:38:35.118573 tst switch_tch_pdch.py:51: start network... 05:38:35.342336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:35.824451 run create_hlr_db(pid=12612): Launched 05:38:35.958431 bus /gobi_6: Setting Powered False 05:38:37.023562 run create_hlr_db(pid=12612): Terminated: ok {rc=0} 05:38:37.454409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12614): Launched 05:38:37.785265 run osmo-hlr_10.42.42.2(pid=12615): Launched 05:38:37.913023 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:38.451700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12617): Launched 05:38:38.781086 run osmo-stp_10.42.42.5(pid=12618): Launched 05:38:38.908669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:38:39.451998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12620): Launched 05:38:39.578648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:38:39.858241 run patchelf(pid=12621): Launched 05:38:40.043304 run osmo-stp_10.42.42.5(pid=12618): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12618)] 05:38:40.183836 run osmo-stp_10.42.42.5(pid=12618): stdout: | (launched: 2022-12-14_05:38:38.720876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:40.324840 run osmo-stp_10.42.42.5(pid=12618): stderr: | 20221214053838915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053838915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053838915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053838915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053838916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053838916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053838916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:40.466562 run osmo-stp_10.42.42.5(pid=12618): stdout: | (launched: 2022-12-14_05:38:38.720876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:40.601565 run osmo-stp_10.42.42.5(pid=12618): stderr: | 20221214053838915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053838915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053838915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053838915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053838916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053838916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053838916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:40.762339 run patchelf(pid=12621): Terminating (SIGINT) 05:38:40.947094 run patchelf(pid=12621): Terminated: ok {rc=0} 05:38:41.080294 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12618): Process ended prematurely: osmo-stp_10.42.42.5(pid=12618) [trial-2400↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12618)] [trial-2400↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:38:41.090467 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 05:38:41.118781 run osmo-hlr_10.42.42.2(pid=12615): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12615)] 05:38:41.169382 run osmo-hlr_10.42.42.2(pid=12615): stdout: | (launched: 2022-12-14_05:38:37.725248) 05:38:41.221872 run osmo-hlr_10.42.42.2(pid=12615): stderr: | 20221214053837923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053837923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053837923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053837923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053837923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053837923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053837936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053837945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053837945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053837945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:41.274434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12614): Terminating (SIGTERM) 05:38:41.316807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12617): Terminating (SIGTERM) 05:38:41.359672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12620): Terminating (SIGTERM) 05:38:41.402457 --- ParallelTerminationStrategy: PID 12614 died... 05:38:41.423020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12614): Terminated: ok {rc=0} 05:38:41.469893 --- ParallelTerminationStrategy: PID 12617 died... 05:38:41.489835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12617): Terminated: ok {rc=0} 05:38:41.536342 --- ParallelTerminationStrategy: PID 12620 died... 05:38:41.556291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12620): Terminated: ok {rc=0} 05:38:41.644592 bus /gobi_0: Setting Powered False 05:38:42.745163 bus /gobi_0: Setting Powered False 05:38:43.862022 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:oc2g --------------------------------------------------------------------- 05:38:45.105996 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:45.110041 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 05:38:45.131223 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 05:38:45.138239 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 05:38:45.191013 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 05:38:45.212210 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 05:38:45.219202 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 05:38:45.757865 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 05:38:45.763854 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 05:38:45.775583 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 05:38:45.808775 tst mo_mt_sms.py: using LAC 38777 05:38:45.956307 tst mo_mt_sms.py: using RAC 17 05:38:46.101348 tst mo_mt_sms.py: using CellId 38777 05:38:46.233971 tst mo_mt_sms.py: using BVCI 38778 05:38:46.374911 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 05:38:46.493374 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 05:38:46.611222 tst mo_mt_sms.py:9: start nitb and bts... 05:38:46.827303 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:38:47.469169 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12625): Launched 05:38:47.781951 run osmo-nitb_10.42.42.2(pid=12626): Launched 05:38:47.953984 run osmo-nitb_10.42.42.2(pid=12626): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12626)] 05:38:48.092654 run osmo-nitb_10.42.42.2(pid=12626): stdout: | (launched: 2022-12-14_05:38:47.725336) 05:38:48.232846 run osmo-nitb_10.42.42.2(pid=12626): stderr: | (launched: 2022-12-14_05:38:47.771308) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:48.373582 run osmo-nitb_10.42.42.2(pid=12626): stdout: | (launched: 2022-12-14_05:38:47.725336) 05:38:48.507994 run osmo-nitb_10.42.42.2(pid=12626): stderr: | (launched: 2022-12-14_05:38:47.771308) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12626): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12626) [trial-2400↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12626)] 05:38:48.899858 tst osmo-nitb_10.42.42.2(pid=12626): stdout: | (launched: 2022-12-14_05:38:47.725336) 05:38:49.025430 tst osmo-nitb_10.42.42.2(pid=12626): stderr: | (launched: 2022-12-14_05:38:47.771308) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:49.173223 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12626): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12626) [trial-2400↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12626)] [trial-2400↪nitb_sms:oc2g↪mo_mt_sms.py:11] 05:38:49.181685 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 05:38:49.188221 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12625): Terminating (SIGTERM) 05:38:49.398389 --- ParallelTerminationStrategy: PID 12625 died... 05:38:49.419516 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12625): Terminated: ok {rc=0} 05:38:49.505782 bus /sierra_3: Setting Powered False 05:38:50.606858 bus /sierra_3: Setting Powered False 05:38:51.727773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:oc2g --------------------------------------------------------------------- 05:38:52.906972 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:52.912321 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 05:38:52.934520 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 05:38:52.962081 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 05:38:53.015934 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 05:38:53.038530 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 05:38:53.065849 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 05:38:53.610783 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:oc2g mo_mt_sms.py ---------------------------------------------- 05:38:53.615841 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:53.627005 tst sms:oc2g: Using 1 x bts (candidates: 1) 05:38:53.660856 tst mo_mt_sms.py: using LAC 38778 05:38:53.789411 tst mo_mt_sms.py: using RAC 18 05:38:53.912837 tst mo_mt_sms.py: using CellId 38778 05:38:54.036524 tst mo_mt_sms.py: using BVCI 38779 05:38:54.151471 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:54.162261 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:54.172640 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:54.183094 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:54.193730 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:54.204269 tst sms:oc2g: Using 1 x modem (candidates: 2) 05:38:54.320391 tst sms:oc2g: Using 1 x modem (candidates: 2) 05:38:54.441286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:54.955650 run create_hlr_db(pid=12630): Launched 05:38:55.091114 bus /sierra_2: Setting Powered False 05:38:56.156151 run create_hlr_db(pid=12630): Terminated: ok {rc=0} 05:38:56.597974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12632): Launched 05:38:56.907118 run osmo-hlr_10.42.42.2(pid=12633): Launched 05:38:57.025712 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:57.572651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12635): Launched 05:38:57.882113 run osmo-stp_10.42.42.5(pid=12636): Launched 05:38:58.000585 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:58.559342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12638): Launched 05:38:58.870441 run osmo-msc_10.42.42.6(pid=12639): Launched 05:38:59.044349 run osmo-stp_10.42.42.5(pid=12636): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12636)] 05:38:59.176049 run osmo-stp_10.42.42.5(pid=12636): stdout: | (launched: 2022-12-14_05:38:57.825342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:59.307160 run osmo-stp_10.42.42.5(pid=12636): stderr: | 20221214053857996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053857996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053857996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053857997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053857997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053857998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053857998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:59.435624 run osmo-stp_10.42.42.5(pid=12636): stdout: | (launched: 2022-12-14_05:38:57.825342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:59.559056 run osmo-stp_10.42.42.5(pid=12636): stderr: | 20221214053857996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053857996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053857996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053857997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053857997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053857998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053857998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:59.706639 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12636): Process ended prematurely: osmo-stp_10.42.42.5(pid=12636) [trial-2400↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12636)] [trial-2400↪sms:oc2g↪mo_mt_sms.py:16] 05:38:59.715319 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 05:38:59.741689 run osmo-hlr_10.42.42.2(pid=12633): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12633)] 05:38:59.790872 run osmo-hlr_10.42.42.2(pid=12633): stdout: | (launched: 2022-12-14_05:38:56.850575) 05:38:59.841097 run osmo-hlr_10.42.42.2(pid=12633): stderr: | 20221214053857028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053857028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053857029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053857029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053857029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053857029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053857040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053857049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053857049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053857049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:59.911148 run osmo-msc_10.42.42.6(pid=12639): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12639)] 05:38:59.958950 run osmo-msc_10.42.42.6(pid=12639): stdout: | (launched: 2022-12-14_05:38:58.813596) 05:39:00.008910 run osmo-msc_10.42.42.6(pid=12639): stderr: | 20221214053859085 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053859085 DLGLOBAL DEBUG validating counter group 0x7f14d9f7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053859085 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053859085 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053859086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053859086 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053859088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053859088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053859088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053859088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:00.059139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12632): Terminating (SIGTERM) 05:39:00.099706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12635): Terminating (SIGTERM) 05:39:00.140028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12638): Terminating (SIGTERM) 05:39:00.180881 --- ParallelTerminationStrategy: PID 12632 died... 05:39:00.200765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12632): Terminated: ok {rc=0} 05:39:00.245546 --- ParallelTerminationStrategy: PID 12635 died... 05:39:00.264510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12635): Terminated: ok {rc=0} 05:39:00.309331 --- ParallelTerminationStrategy: PID 12638 died... 05:39:00.328508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12638): Terminated: ok {rc=0} 05:39:00.412673 bus /sierra_3: Setting Powered False 05:39:01.526825 bus /sierra_3: Setting Powered False 05:39:02.696401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:oc2g --------------------------------------------------------------------- 05:39:03.948130 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:03.952541 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 05:39:03.974047 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 05:39:03.981791 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 05:39:04.021312 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 05:39:04.044225 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 05:39:04.052344 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 05:39:04.576055 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 05:39:04.586122 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 05:39:04.606652 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 05:39:04.646135 tst assert_extension.py: using LAC 38779 05:39:04.774917 tst assert_extension.py: using RAC 19 05:39:04.902829 tst assert_extension.py: using CellId 38779 05:39:05.029344 tst assert_extension.py: using BVCI 38780 05:39:05.149145 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 05:39:05.269754 tst assert_extension.py:10: start nitb and bts... 05:39:05.494246 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:39:06.148083 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12915): Launched 05:39:06.479644 run osmo-nitb_10.42.42.2(pid=12916): Launched 05:39:06.678324 run osmo-nitb_10.42.42.2(pid=12916): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12916)] 05:39:06.821872 run osmo-nitb_10.42.42.2(pid=12916): stdout: | (launched: 2022-12-14_05:39:06.422091) 05:39:06.969997 run osmo-nitb_10.42.42.2(pid=12916): stderr: | (launched: 2022-12-14_05:39:06.468741) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:39:07.114803 run osmo-nitb_10.42.42.2(pid=12916): stdout: | (launched: 2022-12-14_05:39:06.422091) 05:39:07.254389 run osmo-nitb_10.42.42.2(pid=12916): stderr: | (launched: 2022-12-14_05:39:06.468741) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12916): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12916) [trial-2400↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12916)] 05:39:07.621638 tst osmo-nitb_10.42.42.2(pid=12916): stdout: | (launched: 2022-12-14_05:39:06.422091) 05:39:07.750575 tst osmo-nitb_10.42.42.2(pid=12916): stderr: | (launched: 2022-12-14_05:39:06.468741) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:39:07.902688 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12916): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12916) [trial-2400↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12916)] [trial-2400↪nitb_ussd:oc2g↪assert_extension.py:12] 05:39:07.912024 tst assert_extension.py:12: Test FAILED (3.3 sec) 05:39:07.919712 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12915): Terminating (SIGTERM) 05:39:08.133874 --- ParallelTerminationStrategy: PID 12915 died... 05:39:08.156496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12915): Terminated: ok {rc=0} 05:39:08.247332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:oc2g --------------------------------------------------------------------- 05:39:09.415219 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:09.419906 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 05:39:09.441483 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 05:39:09.473209 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 05:39:09.509249 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 05:39:09.533219 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 05:39:09.562299 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 05:39:10.083956 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:oc2g assert_extension.py ---------------------------------------------- 05:39:10.090688 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:39:10.102370 tst ussd:oc2g: Using 1 x bts (candidates: 1) 05:39:10.140059 tst assert_extension.py: using LAC 38780 05:39:10.267732 tst assert_extension.py: using RAC 20 05:39:10.395099 tst assert_extension.py: using CellId 38780 05:39:10.523060 tst assert_extension.py: using BVCI 38781 05:39:10.642013 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:39:10.653616 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:39:10.666137 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:39:10.677929 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:39:10.690748 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:39:10.703467 tst ussd:oc2g: Using 1 x modem (candidates: 1) 05:39:10.826786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:11.329701 run create_hlr_db(pid=12927): Launched 05:39:11.478654 bus /sierra_2: Setting Powered False 05:39:12.545878 run create_hlr_db(pid=12927): Terminated: ok {rc=0} 05:39:13.020359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12929): Launched 05:39:13.372755 run osmo-hlr_10.42.42.2(pid=12930): Launched 05:39:13.627404 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:14.316366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12932): Launched 05:39:14.671103 run osmo-stp_10.42.42.5(pid=12933): Launched 05:39:14.930792 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:15.615307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12935): Launched 05:39:16.024001 run osmo-msc_10.42.42.6(pid=12936): Launched 05:39:16.401127 run osmo-stp_10.42.42.5(pid=12933): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12933)] 05:39:16.681708 run osmo-stp_10.42.42.5(pid=12933): stdout: | (launched: 2022-12-14_05:39:14.607661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:16.823827 run osmo-stp_10.42.42.5(pid=12933): stderr: | 20221214053914906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053914906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053914907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053914907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053914907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053914907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053914908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:16.966259 run osmo-stp_10.42.42.5(pid=12933): stdout: | (launched: 2022-12-14_05:39:14.607661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:17.101449 run osmo-stp_10.42.42.5(pid=12933): stderr: | 20221214053914906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053914906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053914907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053914907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053914907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053914907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053914908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:17.264696 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12933): Process ended prematurely: osmo-stp_10.42.42.5(pid=12933) [trial-2400↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12933)] [trial-2400↪ussd:oc2g↪assert_extension.py:17] 05:39:17.274457 tst assert_extension.py:17: Test FAILED (7.2 sec) 05:39:17.303730 run osmo-hlr_10.42.42.2(pid=12930): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12930)] 05:39:17.358724 run osmo-hlr_10.42.42.2(pid=12930): stdout: | (launched: 2022-12-14_05:39:13.309851) 05:39:17.412099 run osmo-hlr_10.42.42.2(pid=12930): stderr: | 20221214053913616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053913616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053913616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053913616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053913616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053913616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053913634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053913642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053913642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053913642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:17.486722 run osmo-msc_10.42.42.6(pid=12936): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12936)] 05:39:17.539470 run osmo-msc_10.42.42.6(pid=12936): stdout: | (launched: 2022-12-14_05:39:15.948174) 05:39:17.593153 run osmo-msc_10.42.42.6(pid=12936): stderr: | 20221214053916449 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053916449 DLGLOBAL DEBUG validating counter group 0x7f7b2e567c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053916449 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053916449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053916450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053916450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053916451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053916452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053916452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053916452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:17.646802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12929): Terminating (SIGTERM) 05:39:17.690812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12932): Terminating (SIGTERM) 05:39:17.737223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12935): Terminating (SIGTERM) 05:39:17.782997 --- ParallelTerminationStrategy: PID 12929 died... 05:39:17.804364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12929): Terminated: ok {rc=0} 05:39:17.853601 --- ParallelTerminationStrategy: PID 12932 died... 05:39:17.874173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12932): Terminated: ok {rc=0} 05:39:17.921897 --- ParallelTerminationStrategy: PID 12935 died... 05:39:17.943424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12935): Terminated: ok {rc=0} 05:39:18.045407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:39:19.249677 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:19.257223 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:39:19.278781 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:39:19.310263 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:39:19.366550 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:39:19.388090 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:39:19.416940 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:39:19.966315 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:39:20.022608 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:20.034812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:39:20.094387 tst mo_mt_call.py: using LAC 38781 05:39:20.226875 tst mo_mt_call.py: using RAC 21 05:39:20.361275 tst mo_mt_call.py: using CellId 38781 05:39:20.489427 tst mo_mt_call.py: using BVCI 38782 05:39:20.611923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:20.624488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:20.636523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:20.648707 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:20.663000 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:20.676140 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:39:20.802606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:39:20.925990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:21.438272 run create_hlr_db(pid=12941): Launched 05:39:21.603730 bus /sierra_2: Setting Powered False 05:39:22.672613 run create_hlr_db(pid=12941): Terminated: ok {rc=0} 05:39:23.132667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12943): Launched 05:39:23.487703 run osmo-hlr_10.42.42.2(pid=12944): Launched 05:39:23.740785 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:24.433303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12947): Launched 05:39:24.771516 run osmo-stp_10.42.42.5(pid=12948): Launched 05:39:24.901591 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:25.511774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12950): Launched 05:39:25.848341 run osmo-msc_10.42.42.6(pid=12951): Launched 05:39:26.036861 run osmo-stp_10.42.42.5(pid=12948): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12948)] 05:39:26.178801 run osmo-stp_10.42.42.5(pid=12948): stdout: | (launched: 2022-12-14_05:39:24.710298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:26.320386 run osmo-stp_10.42.42.5(pid=12948): stderr: | 20221214053924904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053924904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053924904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053924904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053924905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053924905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053924905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:26.459968 run osmo-stp_10.42.42.5(pid=12948): stdout: | (launched: 2022-12-14_05:39:24.710298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:26.593449 run osmo-stp_10.42.42.5(pid=12948): stderr: | 20221214053924904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053924904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053924904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053924904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053924905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053924905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053924905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:26.753450 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12948): Process ended prematurely: osmo-stp_10.42.42.5(pid=12948) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12948)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:39:26.763047 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 05:39:26.790864 run osmo-hlr_10.42.42.2(pid=12944): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12944)] 05:39:26.841284 run osmo-hlr_10.42.42.2(pid=12944): stdout: | (launched: 2022-12-14_05:39:23.426192) 05:39:26.893304 run osmo-hlr_10.42.42.2(pid=12944): stderr: | 20221214053923726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053923726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053923726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053923726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053923726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053923726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053923743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053923751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053923751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053923751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:26.966027 run osmo-msc_10.42.42.6(pid=12951): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12951)] 05:39:27.016236 run osmo-msc_10.42.42.6(pid=12951): stdout: | (launched: 2022-12-14_05:39:25.787250) 05:39:27.068173 run osmo-msc_10.42.42.6(pid=12951): stderr: | 20221214053926111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053926111 DLGLOBAL DEBUG validating counter group 0x7f7d3eb7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053926112 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053926112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053926112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053926112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053926114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053926114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053926114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053926114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:27.121140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12943): Terminating (SIGTERM) 05:39:27.163271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12947): Terminating (SIGTERM) 05:39:27.205070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12950): Terminating (SIGTERM) 05:39:27.247300 --- ParallelTerminationStrategy: PID 12943 died... 05:39:27.267501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12943): Terminated: ok {rc=0} 05:39:27.314150 --- ParallelTerminationStrategy: PID 12947 died... 05:39:27.334015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12947): Terminated: ok {rc=0} 05:39:27.381091 --- ParallelTerminationStrategy: PID 12950 died... 05:39:27.400864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12950): Terminated: ok {rc=0} 05:39:27.488756 bus /sierra_3: Setting Powered False 05:39:28.585146 bus /sierra_3: Setting Powered False 05:39:29.699224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:39:30.853024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:30.867009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:39:30.928220 tst mo_mt_call_osmux.py: using LAC 38782 05:39:31.065862 tst mo_mt_call_osmux.py: using RAC 22 05:39:31.203496 tst mo_mt_call_osmux.py: using CellId 38782 05:39:31.333509 tst mo_mt_call_osmux.py: using BVCI 38783 05:39:31.488398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:31.503871 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:31.519210 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:31.536717 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:31.553674 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:31.569685 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:39:31.714950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:39:31.840606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:32.369971 run create_hlr_db(pid=12953): Launched 05:39:32.508449 bus /sierra_2: Setting Powered False 05:39:33.574640 run create_hlr_db(pid=12953): Terminated: ok {rc=0} 05:39:34.041135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12955): Launched 05:39:34.378725 run osmo-hlr_10.42.42.2(pid=12956): Launched 05:39:34.508118 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:35.090180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12958): Launched 05:39:35.427746 run osmo-stp_10.42.42.5(pid=12959): Launched 05:39:35.555490 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:36.164423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12961): Launched 05:39:36.501011 run osmo-msc_10.42.42.6(pid=12962): Launched 05:39:36.687835 run osmo-stp_10.42.42.5(pid=12959): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12959)] 05:39:36.828664 run osmo-stp_10.42.42.5(pid=12959): stdout: | (launched: 2022-12-14_05:39:35.365977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:36.970107 run osmo-stp_10.42.42.5(pid=12959): stderr: | 20221214053935563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053935563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053935563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053935564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053935564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053935564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053935565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:37.109825 run osmo-stp_10.42.42.5(pid=12959): stdout: | (launched: 2022-12-14_05:39:35.365977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:37.243560 run osmo-stp_10.42.42.5(pid=12959): stderr: | 20221214053935563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053935563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053935563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053935564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053935564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053935564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053935565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:37.404007 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12959): Process ended prematurely: osmo-stp_10.42.42.5(pid=12959) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12959)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:39:37.413943 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:39:37.441887 run osmo-hlr_10.42.42.2(pid=12956): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12956)] 05:39:37.492156 run osmo-hlr_10.42.42.2(pid=12956): stdout: | (launched: 2022-12-14_05:39:34.317500) 05:39:37.544164 run osmo-hlr_10.42.42.2(pid=12956): stderr: | 20221214053934516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053934516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053934516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053934516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053934516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053934516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053934528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053934537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053934537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053934537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:37.616544 run osmo-msc_10.42.42.6(pid=12962): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12962)] 05:39:37.666593 run osmo-msc_10.42.42.6(pid=12962): stdout: | (launched: 2022-12-14_05:39:36.439690) 05:39:37.718174 run osmo-msc_10.42.42.6(pid=12962): stderr: | 20221214053936766 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053936766 DLGLOBAL DEBUG validating counter group 0x7fc63ec98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053936766 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053936766 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053936766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053936767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053936768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053936769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053936769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053936769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:37.770418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12955): Terminating (SIGTERM) 05:39:37.812027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12958): Terminating (SIGTERM) 05:39:37.853889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12961): Terminating (SIGTERM) 05:39:37.895870 --- ParallelTerminationStrategy: PID 12955 died... 05:39:37.915804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12955): Terminated: ok {rc=0} 05:39:37.962720 --- ParallelTerminationStrategy: PID 12958 died... 05:39:37.982521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12958): Terminated: ok {rc=0} 05:39:38.028626 --- ParallelTerminationStrategy: PID 12961 died... 05:39:38.048351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12961): Terminated: ok {rc=0} 05:39:38.136463 bus /sierra_3: Setting Powered False 05:39:39.234945 bus /sierra_3: Setting Powered False 05:39:40.350673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:39:41.585588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:41.593095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:39:41.614469 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:39:41.642128 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:39:41.693670 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:39:41.714865 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:39:41.741818 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:39:42.294747 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:39:42.348420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:42.360066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:39:42.419960 tst mo_mt_call.py: using LAC 38783 05:39:42.550418 tst mo_mt_call.py: using RAC 23 05:39:42.682114 tst mo_mt_call.py: using CellId 38783 05:39:42.814302 tst mo_mt_call.py: using BVCI 38784 05:39:42.937225 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:42.948747 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:42.960131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:42.971407 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:42.982753 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:42.994102 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:43.113582 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:43.234441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:43.758349 run create_hlr_db(pid=12967): Launched 05:39:43.894242 bus /sierra_2: Setting Powered False 05:39:44.957702 run create_hlr_db(pid=12967): Terminated: ok {rc=0} 05:39:45.406533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12969): Launched 05:39:45.723033 run osmo-hlr_10.42.42.2(pid=12970): Launched 05:39:45.846269 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:46.519076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12972): Launched 05:39:46.854641 run osmo-stp_10.42.42.5(pid=12973): Launched 05:39:47.142862 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:47.792346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12975): Launched 05:39:48.110154 run osmo-msc_10.42.42.6(pid=12976): Launched 05:39:48.286417 run osmo-stp_10.42.42.5(pid=12973): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12973)] 05:39:48.420317 run osmo-stp_10.42.42.5(pid=12973): stdout: | (launched: 2022-12-14_05:39:46.795459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:48.554030 run osmo-stp_10.42.42.5(pid=12973): stderr: | 20221214053947041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053947041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053947041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053947042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053947042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053947042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053947042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:48.685665 run osmo-stp_10.42.42.5(pid=12973): stdout: | (launched: 2022-12-14_05:39:46.795459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:48.811334 run osmo-stp_10.42.42.5(pid=12973): stderr: | 20221214053947041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053947041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053947041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053947042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053947042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053947042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053947042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:48.962016 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12973): Process ended prematurely: osmo-stp_10.42.42.5(pid=12973) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12973)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:39:48.971104 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 05:39:48.998024 run osmo-hlr_10.42.42.2(pid=12970): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12970)] 05:39:49.047076 run osmo-hlr_10.42.42.2(pid=12970): stdout: | (launched: 2022-12-14_05:39:45.665463) 05:39:49.097396 run osmo-hlr_10.42.42.2(pid=12970): stderr: | 20221214053945868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053945868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053945868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053945868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053945868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053945868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053945887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053945899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053945899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053945899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:49.168658 run osmo-msc_10.42.42.6(pid=12976): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12976)] 05:39:49.217127 run osmo-msc_10.42.42.6(pid=12976): stdout: | (launched: 2022-12-14_05:39:48.051531) 05:39:49.267485 run osmo-msc_10.42.42.6(pid=12976): stderr: | 20221214053948325 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053948326 DLGLOBAL DEBUG validating counter group 0x7fa67bc1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053948326 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053948326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053948326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053948326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053948328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053948328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053948328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053948328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:49.318117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12969): Terminating (SIGTERM) 05:39:49.358604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12972): Terminating (SIGTERM) 05:39:49.399200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12975): Terminating (SIGTERM) 05:39:49.439980 --- ParallelTerminationStrategy: PID 12969 died... 05:39:49.459642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12969): Terminated: ok {rc=0} 05:39:49.504832 --- ParallelTerminationStrategy: PID 12972 died... 05:39:49.524234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12972): Terminated: ok {rc=0} 05:39:49.574114 --- ParallelTerminationStrategy: PID 12975 died... 05:39:49.594538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12975): Terminated: ok {rc=0} 05:39:49.684925 bus /sierra_3: Setting Powered False 05:39:50.783613 bus /sierra_3: Setting Powered False 05:39:51.898897 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:39:53.047968 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:53.060431 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:39:53.120104 tst mo_mt_call_osmux.py: using LAC 38784 05:39:53.253289 tst mo_mt_call_osmux.py: using RAC 24 05:39:53.385645 tst mo_mt_call_osmux.py: using CellId 38784 05:39:53.517859 tst mo_mt_call_osmux.py: using BVCI 38785 05:39:53.640027 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:53.651595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:53.663004 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:53.674322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:53.685768 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:53.697186 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:53.816751 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:53.941128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:54.464778 run create_hlr_db(pid=12978): Launched 05:39:54.601162 bus /sierra_2: Setting Powered False 05:39:55.667303 run create_hlr_db(pid=12978): Terminated: ok {rc=0} 05:39:56.116207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12980): Launched 05:39:56.434571 run osmo-hlr_10.42.42.2(pid=12981): Launched 05:39:56.557518 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:57.116198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12983): Launched 05:39:57.432221 run osmo-stp_10.42.42.5(pid=12984): Launched 05:39:57.553883 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:58.123445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12986): Launched 05:39:58.440417 run osmo-msc_10.42.42.6(pid=12987): Launched 05:39:58.617323 run osmo-stp_10.42.42.5(pid=12984): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12984)] 05:39:58.751061 run osmo-stp_10.42.42.5(pid=12984): stdout: | (launched: 2022-12-14_05:39:57.374570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:58.884298 run osmo-stp_10.42.42.5(pid=12984): stderr: | 20221214053957548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053957548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053957548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053957549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053957549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053957550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053957550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:59.015273 run osmo-stp_10.42.42.5(pid=12984): stdout: | (launched: 2022-12-14_05:39:57.374570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:59.140127 run osmo-stp_10.42.42.5(pid=12984): stderr: | 20221214053957548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214053957548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214053957548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214053957549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214053957549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214053957550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214053957550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:59.289786 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12984): Process ended prematurely: osmo-stp_10.42.42.5(pid=12984) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12984)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:39:59.298644 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:39:59.325236 run osmo-hlr_10.42.42.2(pid=12981): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12981)] 05:39:59.374024 run osmo-hlr_10.42.42.2(pid=12981): stdout: | (launched: 2022-12-14_05:39:56.376672) 05:39:59.423719 run osmo-hlr_10.42.42.2(pid=12981): stderr: | 20221214053956553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214053956553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214053956554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214053956554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214053956554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214053956554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214053956566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214053956576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214053956576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214053956576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:59.493508 run osmo-msc_10.42.42.6(pid=12987): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12987)] 05:39:59.541313 run osmo-msc_10.42.42.6(pid=12987): stdout: | (launched: 2022-12-14_05:39:58.382925) 05:39:59.591438 run osmo-msc_10.42.42.6(pid=12987): stderr: | 20221214053958654 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214053958654 DLGLOBAL DEBUG validating counter group 0x7ff113db0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214053958654 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214053958654 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214053958654 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214053958655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214053958656 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214053958657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214053958657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214053958657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:59.641616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12980): Terminating (SIGTERM) 05:39:59.681809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12983): Terminating (SIGTERM) 05:39:59.721972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12986): Terminating (SIGTERM) 05:39:59.762319 --- ParallelTerminationStrategy: PID 12980 died... 05:39:59.781929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12980): Terminated: ok {rc=0} 05:39:59.826417 --- ParallelTerminationStrategy: PID 12983 died... 05:39:59.845512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12983): Terminated: ok {rc=0} 05:39:59.890049 --- ParallelTerminationStrategy: PID 12986 died... 05:39:59.909047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12986): Terminated: ok {rc=0} 05:39:59.995624 bus /sierra_3: Setting Powered False 05:40:01.093429 bus /sierra_3: Setting Powered False 05:40:02.238030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:40:03.478871 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:03.485521 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:40:03.506149 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:40:03.534025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:40:03.584381 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:40:03.605115 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:40:03.631784 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:40:04.185347 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:40:04.239313 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:04.251010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:40:04.308888 tst mo_mt_call.py: using LAC 38785 05:40:04.444139 tst mo_mt_call.py: using RAC 25 05:40:04.575954 tst mo_mt_call.py: using CellId 38785 05:40:04.705453 tst mo_mt_call.py: using BVCI 38786 05:40:04.820586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:04.831811 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:04.842656 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:04.853433 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:04.864586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:04.875750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:40:04.992367 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:40:05.112403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:05.635428 run create_hlr_db(pid=12995): Launched 05:40:05.771630 bus /sierra_2: Setting Powered False 05:40:06.837185 run create_hlr_db(pid=12995): Terminated: ok {rc=0} 05:40:07.304666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12997): Launched 05:40:07.642360 run osmo-hlr_10.42.42.2(pid=12998): Launched 05:40:07.771793 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:08.354930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13000): Launched 05:40:08.692084 run osmo-stp_10.42.42.5(pid=13001): Launched 05:40:08.820013 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:09.428868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13003): Launched 05:40:09.767400 run osmo-msc_10.42.42.6(pid=13004): Launched 05:40:09.954525 run osmo-stp_10.42.42.5(pid=13001): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13001)] 05:40:10.095641 run osmo-stp_10.42.42.5(pid=13001): stdout: | (launched: 2022-12-14_05:40:08.630940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:10.237811 run osmo-stp_10.42.42.5(pid=13001): stderr: | 20221214054008825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054008825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054008825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054008826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054008826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054008826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054008826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:10.377683 run osmo-stp_10.42.42.5(pid=13001): stdout: | (launched: 2022-12-14_05:40:08.630940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:10.511491 run osmo-stp_10.42.42.5(pid=13001): stderr: | 20221214054008825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054008825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054008825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054008826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054008826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054008826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054008826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:10.671952 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13001): Process ended prematurely: osmo-stp_10.42.42.5(pid=13001) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13001)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:40:10.681572 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:40:10.709581 run osmo-hlr_10.42.42.2(pid=12998): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12998)] 05:40:10.759928 run osmo-hlr_10.42.42.2(pid=12998): stdout: | (launched: 2022-12-14_05:40:07.581120) 05:40:10.811750 run osmo-hlr_10.42.42.2(pid=12998): stderr: | 20221214054007781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054007781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054007781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054007781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054007781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054007781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054007794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054007802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054007803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054007803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:10.884011 run osmo-msc_10.42.42.6(pid=13004): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13004)] 05:40:10.934005 run osmo-msc_10.42.42.6(pid=13004): stdout: | (launched: 2022-12-14_05:40:09.705882) 05:40:10.986009 run osmo-msc_10.42.42.6(pid=13004): stderr: | 20221214054010029 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054010029 DLGLOBAL DEBUG validating counter group 0x7f460d9fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054010029 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054010029 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054010029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054010029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054010031 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054010031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054010031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054010032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:11.038107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12997): Terminating (SIGTERM) 05:40:11.079761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13000): Terminating (SIGTERM) 05:40:11.121485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13003): Terminating (SIGTERM) 05:40:11.163610 --- ParallelTerminationStrategy: PID 12997 died... 05:40:11.183747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12997): Terminated: ok {rc=0} 05:40:11.229983 --- ParallelTerminationStrategy: PID 13000 died... 05:40:11.249585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13000): Terminated: ok {rc=0} 05:40:11.295732 --- ParallelTerminationStrategy: PID 13003 died... 05:40:11.315363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13003): Terminated: ok {rc=0} 05:40:11.410228 bus /sierra_3: Setting Powered False 05:40:12.511724 bus /sierra_3: Setting Powered False 05:40:13.625808 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:40:14.778274 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:14.790574 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:40:14.848442 tst mo_mt_call_osmux.py: using LAC 38786 05:40:14.980748 tst mo_mt_call_osmux.py: using RAC 26 05:40:15.112372 tst mo_mt_call_osmux.py: using CellId 38786 05:40:15.245423 tst mo_mt_call_osmux.py: using BVCI 38787 05:40:15.369720 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:15.381440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:15.392839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:15.404288 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:15.415766 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:40:15.427239 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:40:15.548836 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:40:15.667460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:16.216170 run create_hlr_db(pid=13006): Launched 05:40:16.389749 bus /sierra_2: Setting Powered False 05:40:17.451778 run create_hlr_db(pid=13006): Terminated: ok {rc=0} 05:40:17.930526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13008): Launched 05:40:18.268353 run osmo-hlr_10.42.42.2(pid=13009): Launched 05:40:18.396516 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:18.980864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13011): Launched 05:40:19.318883 run osmo-stp_10.42.42.5(pid=13012): Launched 05:40:19.447164 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:20.057692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13014): Launched 05:40:20.396891 run osmo-msc_10.42.42.6(pid=13015): Launched 05:40:20.584416 run osmo-stp_10.42.42.5(pid=13012): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13012)] 05:40:20.725830 run osmo-stp_10.42.42.5(pid=13012): stdout: | (launched: 2022-12-14_05:40:19.257182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:20.867573 run osmo-stp_10.42.42.5(pid=13012): stderr: | 20221214054019453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054019453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054019453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054019454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054019454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054019454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054019454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:21.007718 run osmo-stp_10.42.42.5(pid=13012): stdout: | (launched: 2022-12-14_05:40:19.257182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:21.142144 run osmo-stp_10.42.42.5(pid=13012): stderr: | 20221214054019453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054019453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054019453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054019454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054019454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054019454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054019454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:21.302743 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13012): Process ended prematurely: osmo-stp_10.42.42.5(pid=13012) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13012)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:40:21.312450 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:40:21.340937 run osmo-hlr_10.42.42.2(pid=13009): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13009)] 05:40:21.391771 run osmo-hlr_10.42.42.2(pid=13009): stdout: | (launched: 2022-12-14_05:40:18.206765) 05:40:21.444261 run osmo-hlr_10.42.42.2(pid=13009): stderr: | 20221214054018409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054018410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054018410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054018410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054018410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054018410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054018423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054018431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054018432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054018432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:21.517314 run osmo-msc_10.42.42.6(pid=13015): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13015)] 05:40:21.568054 run osmo-msc_10.42.42.6(pid=13015): stdout: | (launched: 2022-12-14_05:40:20.334924) 05:40:21.620155 run osmo-msc_10.42.42.6(pid=13015): stderr: | 20221214054020661 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054020661 DLGLOBAL DEBUG validating counter group 0x7f615e088c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054020661 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054020661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054020661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054020661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054020663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054020664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054020664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054020664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:21.672901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13008): Terminating (SIGTERM) 05:40:21.715359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13011): Terminating (SIGTERM) 05:40:21.757960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13014): Terminating (SIGTERM) 05:40:21.801403 --- ParallelTerminationStrategy: PID 13008 died... 05:40:21.821796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13008): Terminated: ok {rc=0} 05:40:21.868511 --- ParallelTerminationStrategy: PID 13011 died... 05:40:21.888443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13011): Terminated: ok {rc=0} 05:40:21.935197 --- ParallelTerminationStrategy: PID 13014 died... 05:40:21.955108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13014): Terminated: ok {rc=0} 05:40:22.043392 bus /sierra_3: Setting Powered False 05:40:23.143695 bus /sierra_3: Setting Powered False 05:40:24.262519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:40:25.494532 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:25.501048 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:40:25.521194 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:40:25.547730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:40:25.600931 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:40:25.622919 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:40:25.649370 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:40:26.197240 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:40:26.247995 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:26.259112 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:40:26.314761 tst mo_mt_call.py: using LAC 38787 05:40:26.440510 tst mo_mt_call.py: using RAC 27 05:40:26.573965 tst mo_mt_call.py: using CellId 38787 05:40:26.697428 tst mo_mt_call.py: using BVCI 38788 05:40:26.812054 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:26.823274 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:26.834226 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:26.845091 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:26.856241 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:26.867445 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:26.990331 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:27.111367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:27.605511 run create_hlr_db(pid=13020): Launched 05:40:27.725995 bus /sierra_2: Setting Powered False 05:40:28.789311 run create_hlr_db(pid=13020): Terminated: ok {rc=0} 05:40:29.252899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13022): Launched 05:40:29.591839 run osmo-hlr_10.42.42.2(pid=13023): Launched 05:40:29.720405 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:30.308892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13025): Launched 05:40:30.646852 run osmo-stp_10.42.42.5(pid=13026): Launched 05:40:30.775310 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:31.433311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13028): Launched 05:40:31.788322 run osmo-msc_10.42.42.6(pid=13029): Launched 05:40:32.145461 run osmo-stp_10.42.42.5(pid=13026): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13026)] 05:40:32.390401 run osmo-stp_10.42.42.5(pid=13026): stdout: | (launched: 2022-12-14_05:40:30.585270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:32.523836 run osmo-stp_10.42.42.5(pid=13026): stderr: | 20221214054030779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054030779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054030780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054030780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054030781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054030781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054030781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:32.655865 run osmo-stp_10.42.42.5(pid=13026): stdout: | (launched: 2022-12-14_05:40:30.585270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:32.781813 run osmo-stp_10.42.42.5(pid=13026): stderr: | 20221214054030779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054030779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054030780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054030780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054030781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054030781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054030781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:32.932651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13026): Process ended prematurely: osmo-stp_10.42.42.5(pid=13026) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13026)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:40:32.941848 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 05:40:32.968634 run osmo-hlr_10.42.42.2(pid=13023): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13023)] 05:40:33.017781 run osmo-hlr_10.42.42.2(pid=13023): stdout: | (launched: 2022-12-14_05:40:29.530179) 05:40:33.068282 run osmo-hlr_10.42.42.2(pid=13023): stderr: | 20221214054029729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054029730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054029730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054029730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054029730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054029730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054029742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054029753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054029754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054029754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:33.139202 run osmo-msc_10.42.42.6(pid=13029): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13029)] 05:40:33.187774 run osmo-msc_10.42.42.6(pid=13029): stdout: | (launched: 2022-12-14_05:40:31.725395) 05:40:33.238175 run osmo-msc_10.42.42.6(pid=13029): stderr: | 20221214054032155 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054032156 DLGLOBAL DEBUG validating counter group 0x7f7c9940bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054032156 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054032157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054032157 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054032158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054032163 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054032163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054032163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054032163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:33.289059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13022): Terminating (SIGTERM) 05:40:33.329647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13025): Terminating (SIGTERM) 05:40:33.370146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13028): Terminating (SIGTERM) 05:40:33.410782 --- ParallelTerminationStrategy: PID 13022 died... 05:40:33.430522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13022): Terminated: ok {rc=0} 05:40:33.475518 --- ParallelTerminationStrategy: PID 13025 died... 05:40:33.494672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13025): Terminated: ok {rc=0} 05:40:33.539241 --- ParallelTerminationStrategy: PID 13028 died... 05:40:33.558513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13028): Terminated: ok {rc=0} 05:40:33.643779 bus /sierra_3: Setting Powered False 05:40:34.742060 bus /sierra_3: Setting Powered False 05:40:35.859188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:40:37.004151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:37.016111 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:40:37.071862 tst mo_mt_call_osmux.py: using LAC 38788 05:40:37.198470 tst mo_mt_call_osmux.py: using RAC 28 05:40:37.325631 tst mo_mt_call_osmux.py: using CellId 38788 05:40:37.448227 tst mo_mt_call_osmux.py: using BVCI 38789 05:40:37.562912 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:37.574138 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:37.585068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:37.595987 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:37.607192 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:37.618919 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:37.735839 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:37.858307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:38.385692 run create_hlr_db(pid=13031): Launched 05:40:38.523425 bus /sierra_2: Setting Powered False 05:40:39.589758 run create_hlr_db(pid=13031): Terminated: ok {rc=0} 05:40:40.041475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13033): Launched 05:40:40.359175 run osmo-hlr_10.42.42.2(pid=13034): Launched 05:40:40.481346 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:41.038200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13036): Launched 05:40:41.354743 run osmo-stp_10.42.42.5(pid=13037): Launched 05:40:41.475210 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:42.047494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13039): Launched 05:40:42.387415 run osmo-msc_10.42.42.6(pid=13040): Launched 05:40:42.574404 run osmo-stp_10.42.42.5(pid=13037): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13037)] 05:40:42.718611 run osmo-stp_10.42.42.5(pid=13037): stdout: | (launched: 2022-12-14_05:40:41.296567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:42.861746 run osmo-stp_10.42.42.5(pid=13037): stderr: | 20221214054041469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054041469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054041469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054041470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054041470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054041470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054041470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:43.002070 run osmo-stp_10.42.42.5(pid=13037): stdout: | (launched: 2022-12-14_05:40:41.296567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:43.136276 run osmo-stp_10.42.42.5(pid=13037): stderr: | 20221214054041469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054041469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054041469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054041470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054041470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054041470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054041470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:43.297759 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13037): Process ended prematurely: osmo-stp_10.42.42.5(pid=13037) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13037)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:40:43.307535 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:40:43.335571 run osmo-hlr_10.42.42.2(pid=13034): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13034)] 05:40:43.386088 run osmo-hlr_10.42.42.2(pid=13034): stdout: | (launched: 2022-12-14_05:40:40.301087) 05:40:43.438356 run osmo-hlr_10.42.42.2(pid=13034): stderr: | 20221214054040477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054040477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054040477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054040477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054040477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054040477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054040488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054040496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054040497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054040497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:43.511320 run osmo-msc_10.42.42.6(pid=13040): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13040)] 05:40:43.562209 run osmo-msc_10.42.42.6(pid=13040): stdout: | (launched: 2022-12-14_05:40:42.325772) 05:40:43.614566 run osmo-msc_10.42.42.6(pid=13040): stderr: | 20221214054042650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054042651 DLGLOBAL DEBUG validating counter group 0x7f743315ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054042651 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054042651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054042651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054042651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054042653 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054042653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054042654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054042654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:43.666934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13033): Terminating (SIGTERM) 05:40:43.709243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13036): Terminating (SIGTERM) 05:40:43.751876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13039): Terminating (SIGTERM) 05:40:43.794752 --- ParallelTerminationStrategy: PID 13033 died... 05:40:43.815026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13033): Terminated: ok {rc=0} 05:40:43.861553 --- ParallelTerminationStrategy: PID 13036 died... 05:40:43.881239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13036): Terminated: ok {rc=0} 05:40:43.927982 --- ParallelTerminationStrategy: PID 13039 died... 05:40:43.947768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13039): Terminated: ok {rc=0} 05:40:44.035697 bus /sierra_3: Setting Powered False 05:40:45.134843 bus /sierra_3: Setting Powered False 05:40:46.269267 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:40:47.525633 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:47.532564 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:40:47.553752 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:40:47.581304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:40:47.633571 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:40:47.654052 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:40:47.680755 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:40:48.230808 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:40:48.283092 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:48.294330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:40:48.349442 tst mo_mt_call.py: using LAC 38789 05:40:48.481379 tst mo_mt_call.py: using RAC 29 05:40:48.612336 tst mo_mt_call.py: using CellId 38789 05:40:48.743043 tst mo_mt_call.py: using BVCI 38790 05:40:48.865954 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:48.877804 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:48.889332 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:48.900730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:48.912227 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:48.923769 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:49.044035 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:49.165438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:49.690236 run create_hlr_db(pid=13045): Launched 05:40:49.826564 bus /sierra_2: Setting Powered False 05:40:50.892272 run create_hlr_db(pid=13045): Terminated: ok {rc=0} 05:40:51.341954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13047): Launched 05:40:51.659703 run osmo-hlr_10.42.42.2(pid=13048): Launched 05:40:51.780871 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:52.371310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13051): Launched 05:40:52.709228 run osmo-stp_10.42.42.5(pid=13052): Launched 05:40:52.836530 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:53.445422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13054): Launched 05:40:53.782830 run osmo-msc_10.42.42.6(pid=13055): Launched 05:40:53.969349 run osmo-stp_10.42.42.5(pid=13052): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13052)] 05:40:54.111543 run osmo-stp_10.42.42.5(pid=13052): stdout: | (launched: 2022-12-14_05:40:52.647387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:54.254056 run osmo-stp_10.42.42.5(pid=13052): stderr: | 20221214054052843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054052843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054052843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054052844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054052844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054052844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054052844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:54.394672 run osmo-stp_10.42.42.5(pid=13052): stdout: | (launched: 2022-12-14_05:40:52.647387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:54.528406 run osmo-stp_10.42.42.5(pid=13052): stderr: | 20221214054052843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054052843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054052843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054052844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054052844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054052844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054052844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:54.688917 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13052): Process ended prematurely: osmo-stp_10.42.42.5(pid=13052) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13052)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:40:54.698808 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:40:54.726848 run osmo-hlr_10.42.42.2(pid=13048): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13048)] 05:40:54.777425 run osmo-hlr_10.42.42.2(pid=13048): stdout: | (launched: 2022-12-14_05:40:51.601892) 05:40:54.829806 run osmo-hlr_10.42.42.2(pid=13048): stderr: | 20221214054051778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054051778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054051778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054051778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054051778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054051778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054051790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054051798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054051798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054051798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:54.902431 run osmo-msc_10.42.42.6(pid=13055): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13055)] 05:40:54.952832 run osmo-msc_10.42.42.6(pid=13055): stdout: | (launched: 2022-12-14_05:40:53.720902) 05:40:55.004819 run osmo-msc_10.42.42.6(pid=13055): stderr: | 20221214054054046 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054054046 DLGLOBAL DEBUG validating counter group 0x7f0365304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054054046 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054054046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054054046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054054046 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054054048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054054048 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054054048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054054049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:55.057080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13047): Terminating (SIGTERM) 05:40:55.099289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13051): Terminating (SIGTERM) 05:40:55.141503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13054): Terminating (SIGTERM) 05:40:55.184310 --- ParallelTerminationStrategy: PID 13047 died... 05:40:55.205067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13047): Terminated: ok {rc=0} 05:40:55.252163 --- ParallelTerminationStrategy: PID 13051 died... 05:40:55.272341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13051): Terminated: ok {rc=0} 05:40:55.319065 --- ParallelTerminationStrategy: PID 13054 died... 05:40:55.338928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13054): Terminated: ok {rc=0} 05:40:55.426810 bus /sierra_3: Setting Powered False 05:40:56.526214 bus /sierra_3: Setting Powered False 05:40:57.643715 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:40:58.793955 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:58.805688 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:40:58.862406 tst mo_mt_call_osmux.py: using LAC 38790 05:40:58.987447 tst mo_mt_call_osmux.py: using RAC 30 05:40:59.111967 tst mo_mt_call_osmux.py: using CellId 38790 05:40:59.241672 tst mo_mt_call_osmux.py: using BVCI 38791 05:40:59.366160 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:59.378125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:59.389805 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:59.401435 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:59.413234 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:59.425035 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:59.548785 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:59.670773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:00.196749 run create_hlr_db(pid=13057): Launched 05:41:00.324658 bus /sierra_2: Setting Powered False 05:41:01.392729 run create_hlr_db(pid=13057): Terminated: ok {rc=0} 05:41:01.878270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13059): Launched 05:41:02.231406 run osmo-hlr_10.42.42.2(pid=13060): Launched 05:41:02.360411 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:02.944477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13062): Launched 05:41:03.282761 run osmo-stp_10.42.42.5(pid=13063): Launched 05:41:03.410248 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:04.019068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13065): Launched 05:41:04.358056 run osmo-msc_10.42.42.6(pid=13066): Launched 05:41:04.544810 run osmo-stp_10.42.42.5(pid=13063): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13063)] 05:41:04.686116 run osmo-stp_10.42.42.5(pid=13063): stdout: | (launched: 2022-12-14_05:41:03.220579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:04.828059 run osmo-stp_10.42.42.5(pid=13063): stderr: | 20221214054103418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054103418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054103418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054103418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054103419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054103419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054103419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:04.968448 run osmo-stp_10.42.42.5(pid=13063): stdout: | (launched: 2022-12-14_05:41:03.220579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:05.102432 run osmo-stp_10.42.42.5(pid=13063): stderr: | 20221214054103418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054103418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054103418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054103418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054103419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054103419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054103419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:05.263074 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13063): Process ended prematurely: osmo-stp_10.42.42.5(pid=13063) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13063)] [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:41:05.272521 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:41:05.300852 run osmo-hlr_10.42.42.2(pid=13060): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13060)] 05:41:05.351560 run osmo-hlr_10.42.42.2(pid=13060): stdout: | (launched: 2022-12-14_05:41:02.169363) 05:41:05.403988 run osmo-hlr_10.42.42.2(pid=13060): stderr: | 20221214054102369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054102370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054102370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054102370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054102370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054102370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054102382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054102390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054102391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054102391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:05.477232 run osmo-msc_10.42.42.6(pid=13066): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13066)] 05:41:05.528280 run osmo-msc_10.42.42.6(pid=13066): stdout: | (launched: 2022-12-14_05:41:04.296147) 05:41:05.580616 run osmo-msc_10.42.42.6(pid=13066): stderr: | 20221214054104622 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054104622 DLGLOBAL DEBUG validating counter group 0x7fc53afc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054104622 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054104622 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054104622 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054104622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054104624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054104624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054104625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054104625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:05.633474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13059): Terminating (SIGTERM) 05:41:05.675779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13062): Terminating (SIGTERM) 05:41:05.718447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13065): Terminating (SIGTERM) 05:41:05.761085 --- ParallelTerminationStrategy: PID 13059 died... 05:41:05.781311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13059): Terminated: ok {rc=0} 05:41:05.827676 --- ParallelTerminationStrategy: PID 13062 died... 05:41:05.847443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13062): Terminated: ok {rc=0} 05:41:05.893969 --- ParallelTerminationStrategy: PID 13065 died... 05:41:05.913715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13065): Terminated: ok {rc=0} 05:41:06.001866 bus /sierra_3: Setting Powered False 05:41:07.102292 bus /sierra_3: Setting Powered False 05:41:08.219359 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:41:09.455622 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:09.462109 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:41:09.482516 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:41:09.510123 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:41:09.563323 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:41:09.585979 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:41:09.613411 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:41:10.161694 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:41:10.218656 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:10.230455 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:41:10.289722 tst mo_mt_call.py: using LAC 38791 05:41:10.423461 tst mo_mt_call.py: using RAC 31 05:41:10.557543 tst mo_mt_call.py: using CellId 38791 05:41:10.689400 tst mo_mt_call.py: using BVCI 38792 05:41:10.811496 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:10.823221 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:10.834740 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:10.846089 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:10.857477 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:10.868892 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:41:10.993119 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:41:11.113177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:11.638544 run create_hlr_db(pid=13071): Launched 05:41:11.774787 bus /sierra_2: Setting Powered False 05:41:12.840824 run create_hlr_db(pid=13071): Terminated: ok {rc=0} 05:41:13.292668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13073): Launched 05:41:13.610143 run osmo-hlr_10.42.42.2(pid=13074): Launched 05:41:13.730149 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:14.288692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13076): Launched 05:41:14.605504 run osmo-stp_10.42.42.5(pid=13077): Launched 05:41:14.725952 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:15.298490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13079): Launched 05:41:15.615388 run osmo-msc_10.42.42.6(pid=13080): Launched 05:41:15.792719 run osmo-stp_10.42.42.5(pid=13077): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13077)] 05:41:15.989351 run osmo-stp_10.42.42.5(pid=13077): stdout: | (launched: 2022-12-14_05:41:14.547254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:16.150565 run osmo-stp_10.42.42.5(pid=13077): stderr: | 20221214054114721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054114721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054114722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054114722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054114722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054114722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054114723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:16.285877 run osmo-stp_10.42.42.5(pid=13077): stdout: | (launched: 2022-12-14_05:41:14.547254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:16.415073 run osmo-stp_10.42.42.5(pid=13077): stderr: | 20221214054114721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054114721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054114722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054114722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054114722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054114722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054114723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:16.569868 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13077): Process ended prematurely: osmo-stp_10.42.42.5(pid=13077) [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13077)] [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:41:16.580243 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:41:16.608305 run osmo-hlr_10.42.42.2(pid=13074): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13074)] 05:41:16.658935 run osmo-hlr_10.42.42.2(pid=13074): stdout: | (launched: 2022-12-14_05:41:13.552171) 05:41:16.711598 run osmo-hlr_10.42.42.2(pid=13074): stderr: | 20221214054113730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054113730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054113730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054113730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054113730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054113730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054113742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054113751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054113751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054113751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:16.784092 run osmo-msc_10.42.42.6(pid=13080): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13080)] 05:41:16.834150 run osmo-msc_10.42.42.6(pid=13080): stdout: | (launched: 2022-12-14_05:41:15.557296) 05:41:16.886212 run osmo-msc_10.42.42.6(pid=13080): stderr: | 20221214054115829 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054115829 DLGLOBAL DEBUG validating counter group 0x7feb7e97ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054115829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054115829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054115829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054115830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054115831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054115832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054115832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054115832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:16.938549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13073): Terminating (SIGTERM) 05:41:16.980889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13076): Terminating (SIGTERM) 05:41:17.022864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13079): Terminating (SIGTERM) 05:41:17.065083 --- ParallelTerminationStrategy: PID 13073 died... 05:41:17.085821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13073): Terminated: ok {rc=0} 05:41:17.132636 --- ParallelTerminationStrategy: PID 13076 died... 05:41:17.152941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13076): Terminated: ok {rc=0} 05:41:17.200037 --- ParallelTerminationStrategy: PID 13079 died... 05:41:17.220635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13079): Terminated: ok {rc=0} 05:41:17.311110 bus /sierra_3: Setting Powered False 05:41:18.413868 bus /sierra_3: Setting Powered False 05:41:19.529433 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:41:20.679568 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:20.691662 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:41:20.748738 tst mo_mt_call_osmux.py: using LAC 38792 05:41:20.881344 tst mo_mt_call_osmux.py: using RAC 32 05:41:21.016593 tst mo_mt_call_osmux.py: using CellId 38792 05:41:21.149123 tst mo_mt_call_osmux.py: using BVCI 38793 05:41:21.272207 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:21.284052 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:21.295441 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:21.306800 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:21.318200 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:41:21.329688 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:41:21.449201 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:41:21.571542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:22.096189 run create_hlr_db(pid=13082): Launched 05:41:22.234330 bus /sierra_2: Setting Powered False 05:41:23.300903 run create_hlr_db(pid=13082): Terminated: ok {rc=0} 05:41:23.770897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13085): Launched 05:41:24.110388 run osmo-hlr_10.42.42.2(pid=13086): Launched 05:41:24.239786 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:24.822493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13088): Launched 05:41:25.160651 run osmo-stp_10.42.42.5(pid=13089): Launched 05:41:25.290171 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:25.900870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13091): Launched 05:41:26.219957 run osmo-msc_10.42.42.6(pid=13092): Launched 05:41:26.397369 run osmo-stp_10.42.42.5(pid=13089): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13089)] 05:41:26.532103 run osmo-stp_10.42.42.5(pid=13089): stdout: | (launched: 2022-12-14_05:41:25.099349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:26.666265 run osmo-stp_10.42.42.5(pid=13089): stderr: | 20221214054125292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054125292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054125292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054125293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054125293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054125293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054125293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:26.797831 run osmo-stp_10.42.42.5(pid=13089): stdout: | (launched: 2022-12-14_05:41:25.099349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:26.923395 run osmo-stp_10.42.42.5(pid=13089): stderr: | 20221214054125292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054125292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054125292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054125293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054125293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054125293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054125293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:27.073421 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13089): Process ended prematurely: osmo-stp_10.42.42.5(pid=13089) [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13089)] [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:41:27.082329 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:41:27.109252 run osmo-hlr_10.42.42.2(pid=13086): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13086)] 05:41:27.157881 run osmo-hlr_10.42.42.2(pid=13086): stdout: | (launched: 2022-12-14_05:41:24.048452) 05:41:27.207917 run osmo-hlr_10.42.42.2(pid=13086): stderr: | 20221214054124250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054124250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054124250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054124250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054124250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054124250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054124262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054124271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054124272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054124272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:27.278407 run osmo-msc_10.42.42.6(pid=13092): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13092)] 05:41:27.326603 run osmo-msc_10.42.42.6(pid=13092): stdout: | (launched: 2022-12-14_05:41:26.161629) 05:41:27.376813 run osmo-msc_10.42.42.6(pid=13092): stderr: | 20221214054126436 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054126436 DLGLOBAL DEBUG validating counter group 0x7f658faecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054126437 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054126437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054126437 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054126437 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054126439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054126439 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054126439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054126439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:27.427131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13085): Terminating (SIGTERM) 05:41:27.467463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13088): Terminating (SIGTERM) 05:41:27.508029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13091): Terminating (SIGTERM) 05:41:27.548709 --- ParallelTerminationStrategy: PID 13085 died... 05:41:27.568413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13085): Terminated: ok {rc=0} 05:41:27.613205 --- ParallelTerminationStrategy: PID 13088 died... 05:41:27.632422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13088): Terminated: ok {rc=0} 05:41:27.676869 --- ParallelTerminationStrategy: PID 13091 died... 05:41:27.696394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13091): Terminated: ok {rc=0} 05:41:27.783243 bus /sierra_3: Setting Powered False 05:41:28.882441 bus /sierra_3: Setting Powered False 05:41:29.998813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:41:31.263025 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:31.273530 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:41:31.299122 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:41:31.334519 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:41:31.396013 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:41:31.430759 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:41:31.469128 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:41:32.000706 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:41:32.058327 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:32.070572 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:41:32.130309 tst mo_mt_call.py: using LAC 38793 05:41:32.257462 tst mo_mt_call.py: using RAC 33 05:41:32.385663 tst mo_mt_call.py: using CellId 38793 05:41:32.520475 tst mo_mt_call.py: using BVCI 38794 05:41:32.645183 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:32.656888 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:32.668312 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:32.679622 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:32.691538 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:32.703443 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:32.822749 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:32.945808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:33.437243 run create_hlr_db(pid=13097): Launched 05:41:33.557971 bus /sierra_2: Setting Powered False 05:41:34.621249 run create_hlr_db(pid=13097): Terminated: ok {rc=0} 05:41:35.082139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13099): Launched 05:41:35.421341 run osmo-hlr_10.42.42.2(pid=13100): Launched 05:41:35.549996 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:36.136072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13102): Launched 05:41:36.475316 run osmo-stp_10.42.42.5(pid=13103): Launched 05:41:36.603741 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:37.212707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13105): Launched 05:41:37.550214 run osmo-msc_10.42.42.6(pid=13106): Launched 05:41:37.736898 run osmo-stp_10.42.42.5(pid=13103): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13103)] 05:41:37.879207 run osmo-stp_10.42.42.5(pid=13103): stdout: | (launched: 2022-12-14_05:41:36.413500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:38.022020 run osmo-stp_10.42.42.5(pid=13103): stderr: | 20221214054136608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054136609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054136609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054136609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054136610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054136610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054136610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:38.162313 run osmo-stp_10.42.42.5(pid=13103): stdout: | (launched: 2022-12-14_05:41:36.413500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:38.296588 run osmo-stp_10.42.42.5(pid=13103): stderr: | 20221214054136608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054136609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054136609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054136609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054136610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054136610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054136610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:38.457628 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13103): Process ended prematurely: osmo-stp_10.42.42.5(pid=13103) [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13103)] [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:41:38.467399 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:41:38.496586 run osmo-hlr_10.42.42.2(pid=13100): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13100)] 05:41:38.547060 run osmo-hlr_10.42.42.2(pid=13100): stdout: | (launched: 2022-12-14_05:41:35.359509) 05:41:38.599460 run osmo-hlr_10.42.42.2(pid=13100): stderr: | 20221214054135562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054135562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054135562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054135562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054135562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054135562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054135574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054135583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054135583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054135583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:38.672516 run osmo-msc_10.42.42.6(pid=13106): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13106)] 05:41:38.723231 run osmo-msc_10.42.42.6(pid=13106): stdout: | (launched: 2022-12-14_05:41:37.488267) 05:41:38.775545 run osmo-msc_10.42.42.6(pid=13106): stderr: | 20221214054137812 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054137812 DLGLOBAL DEBUG validating counter group 0x7f1bbb993c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054137812 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054137812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054137812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054137813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054137814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054137815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054137815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054137815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:38.828109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13099): Terminating (SIGTERM) 05:41:38.870475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13102): Terminating (SIGTERM) 05:41:38.913280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13105): Terminating (SIGTERM) 05:41:38.956349 --- ParallelTerminationStrategy: PID 13099 died... 05:41:38.976830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13099): Terminated: ok {rc=0} 05:41:39.023899 --- ParallelTerminationStrategy: PID 13102 died... 05:41:39.043873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13102): Terminated: ok {rc=0} 05:41:39.090568 --- ParallelTerminationStrategy: PID 13105 died... 05:41:39.110377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13105): Terminated: ok {rc=0} 05:41:39.198376 bus /sierra_3: Setting Powered False 05:41:40.297911 bus /sierra_3: Setting Powered False 05:41:41.416898 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:41:42.569247 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:42.581646 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:41:42.641734 tst mo_mt_call_osmux.py: using LAC 38794 05:41:42.774513 tst mo_mt_call_osmux.py: using RAC 34 05:41:42.907950 tst mo_mt_call_osmux.py: using CellId 38794 05:41:43.040798 tst mo_mt_call_osmux.py: using BVCI 38795 05:41:43.163253 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:43.174791 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:43.186305 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:43.197493 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:43.208569 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:43.219793 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:43.340699 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:43.462494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:43.986927 run create_hlr_db(pid=13108): Launched 05:41:44.123227 bus /sierra_2: Setting Powered False 05:41:45.190020 run create_hlr_db(pid=13108): Terminated: ok {rc=0} 05:41:45.645739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13110): Launched 05:41:46.001440 run osmo-hlr_10.42.42.2(pid=13111): Launched 05:41:46.306772 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:47.018741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13113): Launched 05:41:47.373609 run osmo-stp_10.42.42.5(pid=13114): Launched 05:41:47.518507 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:48.096798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13116): Launched 05:41:48.415787 run osmo-msc_10.42.42.6(pid=13117): Launched 05:41:48.593187 run osmo-stp_10.42.42.5(pid=13114): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13114)] 05:41:48.729134 run osmo-stp_10.42.42.5(pid=13114): stdout: | (launched: 2022-12-14_05:41:47.310875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:48.862925 run osmo-stp_10.42.42.5(pid=13114): stderr: | 20221214054147506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054147506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054147507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054147507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054147508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054147508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054147508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:48.995106 run osmo-stp_10.42.42.5(pid=13114): stdout: | (launched: 2022-12-14_05:41:47.310875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:49.121672 run osmo-stp_10.42.42.5(pid=13114): stderr: | 20221214054147506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054147506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054147507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054147507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054147508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054147508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054147508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:49.273385 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13114): Process ended prematurely: osmo-stp_10.42.42.5(pid=13114) [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13114)] [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:41:49.282611 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 05:41:49.309519 run osmo-hlr_10.42.42.2(pid=13111): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13111)] 05:41:49.359915 run osmo-hlr_10.42.42.2(pid=13111): stdout: | (launched: 2022-12-14_05:41:45.935061) 05:41:49.410586 run osmo-hlr_10.42.42.2(pid=13111): stderr: | 20221214054146251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054146251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054146251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054146251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054146251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054146251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054146269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054146287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054146288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054146288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:49.482103 run osmo-msc_10.42.42.6(pid=13117): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13117)] 05:41:49.530383 run osmo-msc_10.42.42.6(pid=13117): stdout: | (launched: 2022-12-14_05:41:48.357377) 05:41:49.580513 run osmo-msc_10.42.42.6(pid=13117): stderr: | 20221214054148634 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054148634 DLGLOBAL DEBUG validating counter group 0x7f09336d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054148634 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054148634 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054148634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054148634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054148636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054148637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054148637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054148637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:49.631197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13110): Terminating (SIGTERM) 05:41:49.671665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13113): Terminating (SIGTERM) 05:41:49.712242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13116): Terminating (SIGTERM) 05:41:49.753282 --- ParallelTerminationStrategy: PID 13110 died... 05:41:49.773241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13110): Terminated: ok {rc=0} 05:41:49.818286 --- ParallelTerminationStrategy: PID 13113 died... 05:41:49.837731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13113): Terminated: ok {rc=0} 05:41:49.882264 --- ParallelTerminationStrategy: PID 13116 died... 05:41:49.901541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13116): Terminated: ok {rc=0} 05:41:49.988348 bus /sierra_3: Setting Powered False 05:41:51.088063 bus /sierra_3: Setting Powered False 05:41:52.203821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:oc2g --------------------------------------------------------------------- 05:41:53.439217 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:53.443596 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 05:41:53.463948 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 05:41:53.492057 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 05:41:53.576600 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 05:41:53.596722 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 05:41:53.623028 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 05:41:54.205323 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 05:41:54.210267 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:54.220794 tst emergency:oc2g: Using 1 x bts (candidates: 1) 05:41:54.255754 tst emergency_mo_mt_call.py: using LAC 38795 05:41:54.388733 tst emergency_mo_mt_call.py: using RAC 35 05:41:54.520309 tst emergency_mo_mt_call.py: using CellId 38795 05:41:54.653367 tst emergency_mo_mt_call.py: using BVCI 38796 05:41:54.776263 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:54.787561 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:54.798751 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:54.809762 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:54.821078 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:54.832222 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:54.951482 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:55.071413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:55.589203 run create_hlr_db(pid=13122): Launched 05:41:55.723980 bus /sierra_2: Setting Powered False 05:41:56.789688 run create_hlr_db(pid=13122): Terminated: ok {rc=0} 05:41:57.253167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13124): Launched 05:41:57.585234 run osmo-hlr_10.42.42.2(pid=13125): Launched 05:41:57.712258 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:58.284421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13127): Launched 05:41:58.617068 run osmo-stp_10.42.42.5(pid=13128): Launched 05:41:58.753545 tst emergency_mo_mt_call.py: using MSISDN 8527 05:41:58.925090 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:59.522706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13130): Launched 05:41:59.854024 run osmo-msc_10.42.42.6(pid=13131): Launched 05:42:00.038481 run osmo-stp_10.42.42.5(pid=13128): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13128)] 05:42:00.177181 run osmo-stp_10.42.42.5(pid=13128): stdout: | (launched: 2022-12-14_05:41:58.555964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:00.316525 run osmo-stp_10.42.42.5(pid=13128): stderr: | 20221214054158750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054158750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054158750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054158751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054158751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054158752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054158752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:00.454356 run osmo-stp_10.42.42.5(pid=13128): stdout: | (launched: 2022-12-14_05:41:58.555964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:00.586495 run osmo-stp_10.42.42.5(pid=13128): stderr: | 20221214054158750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054158750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054158750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054158751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054158751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054158752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054158752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:00.744034 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13128): Process ended prematurely: osmo-stp_10.42.42.5(pid=13128) [trial-2400↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13128)] [trial-2400↪emergency:oc2g↪emergency_mo_mt_call.py:19] 05:42:00.753225 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 05:42:00.781040 run osmo-hlr_10.42.42.2(pid=13125): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13125)] 05:42:00.831488 run osmo-hlr_10.42.42.2(pid=13125): stdout: | (launched: 2022-12-14_05:41:57.523943) 05:42:00.908515 run osmo-hlr_10.42.42.2(pid=13125): stderr: | 20221214054157722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054157723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054157723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054157723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054157723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054157723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054157735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054157744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054157744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054157744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:01.000570 run osmo-msc_10.42.42.6(pid=13131): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13131)] 05:42:01.093305 run osmo-msc_10.42.42.6(pid=13131): stdout: | (launched: 2022-12-14_05:41:59.793280) 05:42:01.159530 run osmo-msc_10.42.42.6(pid=13131): stderr: | 20221214054200116 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054200116 DLGLOBAL DEBUG validating counter group 0x7fb627f76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054200116 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054200116 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054200117 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054200117 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054200119 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054200119 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054200119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054200119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:42:01.224829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13124): Terminating (SIGTERM) 05:42:01.271417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13127): Terminating (SIGTERM) 05:42:01.315272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13130): Terminating (SIGTERM) 05:42:01.359675 --- ParallelTerminationStrategy: PID 13124 died... 05:42:01.380717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13124): Terminated: ok {rc=0} 05:42:01.429413 --- ParallelTerminationStrategy: PID 13127 died... 05:42:01.450362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13127): Terminated: ok {rc=0} 05:42:01.498289 --- ParallelTerminationStrategy: PID 13130 died... 05:42:01.519107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13130): Terminated: ok {rc=0} 05:42:01.609849 bus /sierra_3: Setting Powered False 05:42:02.713380 bus /sierra_3: Setting Powered False 05:42:03.832921 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 05:42:04.921756 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:42:04.933427 tst emergency:oc2g: Using 1 x bts (candidates: 1) 05:42:04.970205 tst emergency_preemptive_call.py: using LAC 38796 05:42:05.101161 tst emergency_preemptive_call.py: using RAC 36 05:42:05.231705 tst emergency_preemptive_call.py: using CellId 38796 05:42:05.363773 tst emergency_preemptive_call.py: using BVCI 38797 05:42:05.484259 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:42:05.495452 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:42:05.506440 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:42:05.517431 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:42:05.528371 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:42:05.539258 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:42:05.656440 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:42:05.777751 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:42:05.895919 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:42:06.015968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:06.534011 run create_hlr_db(pid=13142): Launched 05:42:06.668451 bus /sierra_2: Setting Powered False 05:42:07.734750 run create_hlr_db(pid=13142): Terminated: ok {rc=0} 05:42:08.178658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13144): Launched 05:42:08.492244 run osmo-hlr_10.42.42.2(pid=13145): Launched 05:42:08.613082 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:09.158947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13147): Launched 05:42:09.469950 run osmo-stp_10.42.42.5(pid=13148): Launched 05:42:09.599402 tst emergency_preemptive_call.py: using MSISDN 8528 05:42:09.768414 run osmo-msc_10.42.42.6: Starting osmo-msc 05:42:10.324443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13150): Launched 05:42:10.635379 run osmo-msc_10.42.42.6(pid=13151): Launched 05:42:10.810329 run osmo-stp_10.42.42.5(pid=13148): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13148)] 05:42:10.942140 run osmo-stp_10.42.42.5(pid=13148): stdout: | (launched: 2022-12-14_05:42:09.412459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:11.074075 run osmo-stp_10.42.42.5(pid=13148): stderr: | 20221214054209584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054209584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054209585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054209585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054209585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054209586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054209586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:11.202876 run osmo-stp_10.42.42.5(pid=13148): stdout: | (launched: 2022-12-14_05:42:09.412459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:11.325837 run osmo-stp_10.42.42.5(pid=13148): stderr: | 20221214054209584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054209584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054209585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054209585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054209585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054209586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054209586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:11.473986 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13148): Process ended prematurely: osmo-stp_10.42.42.5(pid=13148) [trial-2400↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13148)] [trial-2400↪emergency:oc2g↪emergency_preemptive_call.py:32] 05:42:11.482323 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 05:42:11.508717 run osmo-hlr_10.42.42.2(pid=13145): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13145)] 05:42:11.557334 run osmo-hlr_10.42.42.2(pid=13145): stdout: | (launched: 2022-12-14_05:42:08.434779) 05:42:11.607285 run osmo-hlr_10.42.42.2(pid=13145): stderr: | 20221214054208613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054208613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054208613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054208613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054208613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054208613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054208626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054208636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054208636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054208636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:11.677390 run osmo-msc_10.42.42.6(pid=13151): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13151)] 05:42:11.724908 run osmo-msc_10.42.42.6(pid=13151): stdout: | (launched: 2022-12-14_05:42:10.577356) 05:42:11.774741 run osmo-msc_10.42.42.6(pid=13151): stderr: | 20221214054210848 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054210848 DLGLOBAL DEBUG validating counter group 0x7fb9d2db5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054210849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054210849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054210849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054210849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054210851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054210851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054210851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054210851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:42:11.824908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13144): Terminating (SIGTERM) 05:42:11.865160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13147): Terminating (SIGTERM) 05:42:11.905507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13150): Terminating (SIGTERM) 05:42:11.946087 --- ParallelTerminationStrategy: PID 13144 died... 05:42:11.965666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13144): Terminated: ok {rc=0} 05:42:12.010098 --- ParallelTerminationStrategy: PID 13147 died... 05:42:12.029138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13147): Terminated: ok {rc=0} 05:42:12.073486 --- ParallelTerminationStrategy: PID 13150 died... 05:42:12.092692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13150): Terminated: ok {rc=0} 05:42:12.179915 bus /sierra_9: Setting Powered False 05:42:13.279747 bus /sierra_9: Setting Powered False 05:42:14.396734 bus /sierra_8: Setting Powered False 05:42:15.495452 bus /sierra_8: Setting Powered False 05:42:16.607977 bus /sierra_3: Setting Powered False 05:42:17.704677 bus /sierra_3: Setting Powered False 05:42:18.816882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:oc2g --------------------------------------------------------------------- 05:42:20.087845 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:42:20.092870 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 05:42:20.113860 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 05:42:20.152331 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 05:42:20.236339 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 05:42:20.256789 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 05:42:20.295217 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 05:42:20.886995 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 05:42:20.939247 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:20.949765 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:20.982175 tst cs_paging_gprs_active.py: using LAC 38797 05:42:21.105357 tst cs_paging_gprs_active.py: using RAC 37 05:42:21.227748 tst cs_paging_gprs_active.py: using CellId 38797 05:42:21.351753 tst cs_paging_gprs_active.py: using BVCI 38798 05:42:21.468481 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.479064 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.489410 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.499656 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.509881 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.520320 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.530896 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.541476 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:21.552775 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:21.675113 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:21.794916 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:42:22.008879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:22.327742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13156): Launched 05:42:22.604678 run iperf3-srv_10.42.42.10(pid=13157): Launched 05:42:22.724011 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:42:22.937794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:23.256312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13158): Launched 05:42:23.532210 run iperf3-srv_10.42.42.10(pid=13159): Launched 05:42:23.651084 tst cs_paging_gprs_active.py:38: start network... 05:42:23.863856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:24.353136 run create_hlr_db(pid=13160): Launched 05:42:24.473766 bus /sierra_2: Setting Powered False 05:42:25.536208 run create_hlr_db(pid=13160): Terminated: ok {rc=0} 05:42:25.996809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13162): Launched 05:42:26.336523 run osmo-hlr_10.42.42.2(pid=13163): Launched 05:42:26.466038 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:27.049304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13165): Launched 05:42:27.387578 run osmo-stp_10.42.42.5(pid=13166): Launched 05:42:27.515825 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:28.098095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13168): Launched 05:42:28.228177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:28.514442 run patchelf(pid=13169): Launched 05:42:28.702103 run osmo-stp_10.42.42.5(pid=13166): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13166)] 05:42:28.845111 run osmo-stp_10.42.42.5(pid=13166): stdout: | (launched: 2022-12-14_05:42:27.325724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:28.989456 run osmo-stp_10.42.42.5(pid=13166): stderr: | 20221214054227520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054227520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054227520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054227520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054227521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054227521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054227521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:29.133733 run osmo-stp_10.42.42.5(pid=13166): stdout: | (launched: 2022-12-14_05:42:27.325724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:29.272129 run osmo-stp_10.42.42.5(pid=13166): stderr: | 20221214054227520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054227520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054227520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054227520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054227521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054227521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054227521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:29.435948 run patchelf(pid=13169): Terminating (SIGINT) 05:42:29.624942 run patchelf(pid=13169): Terminated: ok {rc=0} 05:42:29.761570 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13166): Process ended prematurely: osmo-stp_10.42.42.5(pid=13166) [trial-2400↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13166)] [trial-2400↪gprs:oc2g↪cs_paging_gprs_active.py:38] 05:42:29.771719 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:42:29.800645 run osmo-hlr_10.42.42.2(pid=13163): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13163)] 05:42:29.851111 run osmo-hlr_10.42.42.2(pid=13163): stdout: | (launched: 2022-12-14_05:42:26.274600) 05:42:29.903555 run osmo-hlr_10.42.42.2(pid=13163): stderr: | 20221214054226476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054226476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054226476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054226476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054226476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054226476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054226488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054226497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054226497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054226497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:29.956119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13156): Terminating (SIGTERM) 05:42:29.998349 run iperf3-srv_10.42.42.10(pid=13157): Terminating (SIGTERM) 05:42:30.040343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13158): Terminating (SIGTERM) 05:42:30.082883 run iperf3-srv_10.42.42.10(pid=13159): Terminating (SIGTERM) 05:42:30.126495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13162): Terminating (SIGTERM) 05:42:30.168930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13165): Terminating (SIGTERM) 05:42:30.211314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13168): Terminating (SIGTERM) 05:42:30.253757 --- ParallelTerminationStrategy: PID 13156 died... 05:42:30.274119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13156): Terminated: ok {rc=0} 05:42:30.320665 --- ParallelTerminationStrategy: PID 13157 died... 05:42:30.340321 run iperf3-srv_10.42.42.10(pid=13157): Terminated {rc=256} 05:42:30.386494 --- ParallelTerminationStrategy: PID 13158 died... 05:42:30.406227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13158): Terminated: ok {rc=0} 05:42:30.452437 --- ParallelTerminationStrategy: PID 13159 died... 05:42:30.472163 run iperf3-srv_10.42.42.10(pid=13159): Terminated {rc=256} 05:42:30.518355 --- ParallelTerminationStrategy: PID 13162 died... 05:42:30.538242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13162): Terminated: ok {rc=0} 05:42:30.584681 --- ParallelTerminationStrategy: PID 13165 died... 05:42:30.604529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13165): Terminated: ok {rc=0} 05:42:30.651118 --- ParallelTerminationStrategy: PID 13168 died... 05:42:30.670908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13168): Terminated: ok {rc=0} 05:42:30.758955 bus /gobi_0: Setting Powered False 05:42:31.857101 bus /gobi_0: Setting Powered False 05:42:32.970863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g iperf3.py ---------------------------------------------- 05:42:34.122049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.133835 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:34.169883 tst iperf3.py: using LAC 38798 05:42:34.301634 tst iperf3.py: using RAC 38 05:42:34.434423 tst iperf3.py: using CellId 38798 05:42:34.565425 tst iperf3.py: using BVCI 38799 05:42:34.690296 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.701417 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.712313 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.723266 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.734159 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.745000 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.756016 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.766926 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:34.778025 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:34.901672 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:42:35.131729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:35.472863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13170): Launched 05:42:35.767535 run iperf3-srv_10.42.42.10(pid=13171): Launched 05:42:35.893955 tst iperf3.py:8: start network... 05:42:36.123595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:36.648862 run create_hlr_db(pid=13172): Launched 05:42:36.784607 bus /gobi_6: Setting Powered False 05:42:37.851268 run create_hlr_db(pid=13172): Terminated: ok {rc=0} 05:42:38.302566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13174): Launched 05:42:38.620410 run osmo-hlr_10.42.42.2(pid=13175): Launched 05:42:38.741490 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:39.299273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13177): Launched 05:42:39.616849 run osmo-stp_10.42.42.5(pid=13178): Launched 05:42:39.738308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:40.286171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13180): Launched 05:42:40.408215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:40.677117 run patchelf(pid=13181): Launched 05:42:40.853301 run osmo-stp_10.42.42.5(pid=13178): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13178)] 05:42:40.987317 run osmo-stp_10.42.42.5(pid=13178): stdout: | (launched: 2022-12-14_05:42:39.558166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:41.122795 run osmo-stp_10.42.42.5(pid=13178): stderr: | 20221214054239730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054239731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054239731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054239731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054239732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054239732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054239732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:41.258985 run osmo-stp_10.42.42.5(pid=13178): stdout: | (launched: 2022-12-14_05:42:39.558166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:41.388248 run osmo-stp_10.42.42.5(pid=13178): stderr: | 20221214054239730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054239731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054239731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054239731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054239732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054239732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054239732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:41.541795 run patchelf(pid=13181): Terminating (SIGINT) 05:42:41.718922 run patchelf(pid=13181): Terminated: ok {rc=0} 05:42:41.846978 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13178): Process ended prematurely: osmo-stp_10.42.42.5(pid=13178) [trial-2400↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13178)] [trial-2400↪gprs:oc2g↪iperf3.py:8] 05:42:41.856511 tst iperf3.py:8: Test FAILED (7.8 sec) 05:42:41.883824 run osmo-hlr_10.42.42.2(pid=13175): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13175)] 05:42:41.932116 run osmo-hlr_10.42.42.2(pid=13175): stdout: | (launched: 2022-12-14_05:42:38.561950) 05:42:41.981810 run osmo-hlr_10.42.42.2(pid=13175): stderr: | 20221214054238738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054238738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054238738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054238738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054238739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054238739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054238750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054238758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054238758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054238759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:42.031808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13170): Terminating (SIGTERM) 05:42:42.072157 run iperf3-srv_10.42.42.10(pid=13171): Terminating (SIGTERM) 05:42:42.112398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13174): Terminating (SIGTERM) 05:42:42.152717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13177): Terminating (SIGTERM) 05:42:42.192865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13180): Terminating (SIGTERM) 05:42:42.233380 --- ParallelTerminationStrategy: PID 13170 died... 05:42:42.253105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13170): Terminated: ok {rc=0} 05:42:42.297568 --- ParallelTerminationStrategy: PID 13171 died... 05:42:42.316395 run iperf3-srv_10.42.42.10(pid=13171): Terminated {rc=256} 05:42:42.361288 --- ParallelTerminationStrategy: PID 13174 died... 05:42:42.380379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13174): Terminated: ok {rc=0} 05:42:42.425327 --- ParallelTerminationStrategy: PID 13177 died... 05:42:42.444627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13177): Terminated: ok {rc=0} 05:42:42.489510 --- ParallelTerminationStrategy: PID 13180 died... 05:42:42.508768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13180): Terminated: ok {rc=0} 05:42:42.595060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g iperf3m4.py ---------------------------------------------- 05:42:43.744421 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:43.755833 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:43.788788 tst iperf3m4.py: using LAC 38799 05:42:43.913272 tst iperf3m4.py: using RAC 39 05:42:44.043144 tst iperf3m4.py: using CellId 38799 05:42:44.165985 tst iperf3m4.py: using BVCI 38800 05:42:44.282613 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.293158 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.303562 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.314006 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.324215 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.334757 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.345391 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.355834 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:44.366762 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:44.491666 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:44.614518 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:44.733899 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:44.853073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:42:45.066941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:45.387760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13182): Launched 05:42:45.665336 run iperf3-srv_10.42.42.10(pid=13183): Launched 05:42:45.784493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:42:46.020547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:46.352383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13184): Launched 05:42:46.652242 run iperf3-srv_10.42.42.10(pid=13185): Launched 05:42:46.789204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:42:47.007277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:47.332554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13186): Launched 05:42:47.608730 run iperf3-srv_10.42.42.10(pid=13187): Launched 05:42:47.727172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:42:47.938814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:48.257296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13188): Launched 05:42:48.533181 run iperf3-srv_10.42.42.10(pid=13189): Launched 05:42:48.651612 tst iperf3m4.py:8: start network... 05:42:48.863853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:49.354476 run create_hlr_db(pid=13190): Launched 05:42:49.474950 bus /gobi_6: Setting Powered False 05:42:50.537236 run create_hlr_db(pid=13190): Terminated: ok {rc=0} 05:42:50.977517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13192): Launched 05:42:51.293906 run osmo-hlr_10.42.42.2(pid=13193): Launched 05:42:51.413210 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:51.958490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13195): Launched 05:42:52.275201 run osmo-stp_10.42.42.5(pid=13196): Launched 05:42:52.395239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:52.939488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13198): Launched 05:42:53.061513 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:53.330016 run patchelf(pid=13199): Launched 05:42:53.505412 run osmo-stp_10.42.42.5(pid=13196): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13196)] 05:42:53.638872 run osmo-stp_10.42.42.5(pid=13196): stdout: | (launched: 2022-12-14_05:42:52.216400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:53.774056 run osmo-stp_10.42.42.5(pid=13196): stderr: | 20221214054252387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054252387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054252387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054252388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054252388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054252388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054252388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:53.909527 run osmo-stp_10.42.42.5(pid=13196): stdout: | (launched: 2022-12-14_05:42:52.216400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:54.038278 run osmo-stp_10.42.42.5(pid=13196): stderr: | 20221214054252387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054252387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054252387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054252388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054252388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054252388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054252388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:54.191327 run patchelf(pid=13199): Terminating (SIGINT) 05:42:54.368450 run patchelf(pid=13199): Terminated: ok {rc=0} 05:42:54.496161 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13196): Process ended prematurely: osmo-stp_10.42.42.5(pid=13196) [trial-2400↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13196)] [trial-2400↪gprs:oc2g↪iperf3m4.py:8] 05:42:54.505895 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:42:54.533225 run osmo-hlr_10.42.42.2(pid=13193): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13193)] 05:42:54.581732 run osmo-hlr_10.42.42.2(pid=13193): stdout: | (launched: 2022-12-14_05:42:51.235042) 05:42:54.631173 run osmo-hlr_10.42.42.2(pid=13193): stderr: | 20221214054251411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054251411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054251411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054251411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054251411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054251411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054251423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054251434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054251434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054251434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:54.681308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13182): Terminating (SIGTERM) 05:42:54.721499 run iperf3-srv_10.42.42.10(pid=13183): Terminating (SIGTERM) 05:42:54.761585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13184): Terminating (SIGTERM) 05:42:54.801820 run iperf3-srv_10.42.42.10(pid=13185): Terminating (SIGTERM) 05:42:54.841851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13186): Terminating (SIGTERM) 05:42:54.882020 run iperf3-srv_10.42.42.10(pid=13187): Terminating (SIGTERM) 05:42:54.922059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13188): Terminating (SIGTERM) 05:42:54.962381 run iperf3-srv_10.42.42.10(pid=13189): Terminating (SIGTERM) 05:42:55.002580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13192): Terminating (SIGTERM) 05:42:55.042743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13195): Terminating (SIGTERM) 05:42:55.082770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13198): Terminating (SIGTERM) 05:42:55.123188 --- ParallelTerminationStrategy: PID 13182 died... 05:42:55.142720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13182): Terminated: ok {rc=0} 05:42:55.187385 --- ParallelTerminationStrategy: PID 13183 died... 05:42:55.206411 run iperf3-srv_10.42.42.10(pid=13183): Terminated {rc=256} 05:42:55.250638 --- ParallelTerminationStrategy: PID 13184 died... 05:42:55.269727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13184): Terminated: ok {rc=0} 05:42:55.313958 --- ParallelTerminationStrategy: PID 13185 died... 05:42:55.332903 run iperf3-srv_10.42.42.10(pid=13185): Terminated {rc=256} 05:42:55.377141 --- ParallelTerminationStrategy: PID 13186 died... 05:42:55.396143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13186): Terminated: ok {rc=0} 05:42:55.440455 --- ParallelTerminationStrategy: PID 13187 died... 05:42:55.459516 run iperf3-srv_10.42.42.10(pid=13187): Terminated {rc=256} 05:42:55.503764 --- ParallelTerminationStrategy: PID 13188 died... 05:42:55.522848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13188): Terminated: ok {rc=0} 05:42:55.567195 --- ParallelTerminationStrategy: PID 13189 died... 05:42:55.586667 run iperf3-srv_10.42.42.10(pid=13189): Terminated {rc=256} 05:42:55.630972 --- ParallelTerminationStrategy: PID 13192 died... 05:42:55.650093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13192): Terminated: ok {rc=0} 05:42:55.694276 --- ParallelTerminationStrategy: PID 13195 died... 05:42:55.713421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13195): Terminated: ok {rc=0} 05:42:55.757637 --- ParallelTerminationStrategy: PID 13198 died... 05:42:55.776709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13198): Terminated: ok {rc=0} 05:42:55.863468 bus /gobi_4: Setting Powered False 05:42:56.962630 bus /gobi_4: Setting Powered False 05:42:58.079013 bus /gobi_1: Setting Powered False 05:42:59.178548 bus /gobi_1: Setting Powered False 05:43:00.293481 bus /gobi_0: Setting Powered False 05:43:01.403702 bus /gobi_0: Setting Powered False 05:43:02.535205 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g ping.py ---------------------------------------------- 05:43:03.638941 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:03.650859 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:43:03.687402 tst ping.py: using LAC 38800 05:43:03.823272 tst ping.py: using RAC 40 05:43:03.966710 tst ping.py: using CellId 38800 05:43:04.098927 tst ping.py: using BVCI 38801 05:43:04.221533 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.232660 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.243695 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.254571 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.265512 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.276400 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.287338 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:04.298183 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:43:04.418951 tst ping.py:19: start network... 05:43:04.644751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:05.159573 run create_hlr_db(pid=13200): Launched 05:43:05.294397 bus /gobi_6: Setting Powered False 05:43:06.359750 run create_hlr_db(pid=13200): Terminated: ok {rc=0} 05:43:06.803379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13202): Launched 05:43:07.115161 run osmo-hlr_10.42.42.2(pid=13203): Launched 05:43:07.233494 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:07.786754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13205): Launched 05:43:08.098632 run osmo-stp_10.42.42.5(pid=13206): Launched 05:43:08.217425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:08.753859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13208): Launched 05:43:08.872826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:09.136898 run patchelf(pid=13209): Launched 05:43:09.309964 run osmo-stp_10.42.42.5(pid=13206): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13206)] 05:43:09.441421 run osmo-stp_10.42.42.5(pid=13206): stdout: | (launched: 2022-12-14_05:43:08.040438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:09.574336 run osmo-stp_10.42.42.5(pid=13206): stderr: | 20221214054308214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054308214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054308214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054308214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054308215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054308215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054308215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:09.707371 run osmo-stp_10.42.42.5(pid=13206): stdout: | (launched: 2022-12-14_05:43:08.040438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:09.834313 run osmo-stp_10.42.42.5(pid=13206): stderr: | 20221214054308214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054308214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054308214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054308214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054308215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054308215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054308215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:09.984646 run patchelf(pid=13209): Terminating (SIGINT) 05:43:10.158938 run patchelf(pid=13209): Terminated: ok {rc=0} 05:43:10.283944 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13206): Process ended prematurely: osmo-stp_10.42.42.5(pid=13206) [trial-2400↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13206)] [trial-2400↪gprs:oc2g↪ping.py:22] 05:43:10.292942 tst ping.py:22: Test FAILED (6.6 sec) 05:43:10.320264 run osmo-hlr_10.42.42.2(pid=13203): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13203)] 05:43:10.369128 run osmo-hlr_10.42.42.2(pid=13203): stdout: | (launched: 2022-12-14_05:43:07.057657) 05:43:10.419234 run osmo-hlr_10.42.42.2(pid=13203): stderr: | 20221214054307235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054307235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054307235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054307235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054307235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054307235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054307248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054307258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054307259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054307259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:10.469539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13202): Terminating (SIGTERM) 05:43:10.510349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13205): Terminating (SIGTERM) 05:43:10.551097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13208): Terminating (SIGTERM) 05:43:10.592121 --- ParallelTerminationStrategy: PID 13202 died... 05:43:10.611686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13202): Terminated: ok {rc=0} 05:43:10.656758 --- ParallelTerminationStrategy: PID 13205 died... 05:43:10.676147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13205): Terminated: ok {rc=0} 05:43:10.720868 --- ParallelTerminationStrategy: PID 13208 died... 05:43:10.740566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13208): Terminated: ok {rc=0} 05:43:10.825809 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 05:43:11.913982 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:11.926446 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:43:11.963897 tst ping_idle_ping.py: using LAC 38801 05:43:12.091387 tst ping_idle_ping.py: using RAC 41 05:43:12.214138 tst ping_idle_ping.py: using CellId 38801 05:43:12.339456 tst ping_idle_ping.py: using BVCI 38802 05:43:12.452669 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.463303 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.473779 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.484070 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.494347 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.504870 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.515539 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:43:12.526360 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:43:12.647379 tst ping_idle_ping.py:24: start network... 05:43:12.872856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:13.391758 run create_hlr_db(pid=13210): Launched 05:43:13.526971 bus /gobi_6: Setting Powered False 05:43:14.592768 run create_hlr_db(pid=13210): Terminated: ok {rc=0} 05:43:15.054664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13212): Launched 05:43:15.388418 run osmo-hlr_10.42.42.2(pid=13213): Launched 05:43:15.515714 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:16.106367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13215): Launched 05:43:16.457522 run osmo-stp_10.42.42.5(pid=13216): Launched 05:43:16.707752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:17.358711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13218): Launched 05:43:17.485261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:17.766849 run patchelf(pid=13219): Launched 05:43:17.951241 run osmo-stp_10.42.42.5(pid=13216): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13216)] 05:43:18.091707 run osmo-stp_10.42.42.5(pid=13216): stdout: | (launched: 2022-12-14_05:43:16.394651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:18.234125 run osmo-stp_10.42.42.5(pid=13216): stderr: | 20221214054316691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054316691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054316691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054316691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054316692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054316692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054316692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:18.376416 run osmo-stp_10.42.42.5(pid=13216): stdout: | (launched: 2022-12-14_05:43:16.394651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:18.512153 run osmo-stp_10.42.42.5(pid=13216): stderr: | 20221214054316691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054316691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054316691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054316691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054316692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054316692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054316692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:18.673081 run patchelf(pid=13219): Terminating (SIGINT) 05:43:18.858349 run patchelf(pid=13219): Terminated: ok {rc=0} 05:43:18.991725 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13216): Process ended prematurely: osmo-stp_10.42.42.5(pid=13216) [trial-2400↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13216)] [trial-2400↪gprs:oc2g↪ping_idle_ping.py:27] 05:43:19.001403 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 05:43:19.029716 run osmo-hlr_10.42.42.2(pid=13213): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13213)] 05:43:19.079786 run osmo-hlr_10.42.42.2(pid=13213): stdout: | (launched: 2022-12-14_05:43:15.327388) 05:43:19.131874 run osmo-hlr_10.42.42.2(pid=13213): stderr: | 20221214054315527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054315527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054315527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054315527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054315527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054315527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054315539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054315548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054315548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054315548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:19.185059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13212): Terminating (SIGTERM) 05:43:19.227501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13215): Terminating (SIGTERM) 05:43:19.270340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13218): Terminating (SIGTERM) 05:43:19.312856 --- ParallelTerminationStrategy: PID 13212 died... 05:43:19.333374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13212): Terminated: ok {rc=0} 05:43:19.379854 --- ParallelTerminationStrategy: PID 13215 died... 05:43:19.399701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13215): Terminated: ok {rc=0} 05:43:19.445838 --- ParallelTerminationStrategy: PID 13218 died... 05:43:19.465722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13218): Terminated: ok {rc=0} 05:43:19.553269 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 05:43:20.845852 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:43:20.851937 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:43:20.873357 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:43:20.913777 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:43:21.002268 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:43:21.023098 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:43:21.061759 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:43:21.656166 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:43:21.709304 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:21.720355 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:21.757869 tst cs_paging_gprs_active.py: using LAC 38802 05:43:21.882619 tst cs_paging_gprs_active.py: using RAC 42 05:43:22.005296 tst cs_paging_gprs_active.py: using CellId 38802 05:43:22.128829 tst cs_paging_gprs_active.py: using BVCI 38803 05:43:22.242147 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.253192 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.263872 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.274610 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.285483 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.296022 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.307494 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.318686 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.329807 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:22.448684 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:22.569536 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:43:22.795512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:23.130523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13225): Launched 05:43:23.421346 run iperf3-srv_10.42.42.10(pid=13226): Launched 05:43:23.545457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:43:23.769639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:24.103490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13227): Launched 05:43:24.392495 run iperf3-srv_10.42.42.10(pid=13228): Launched 05:43:24.516611 tst cs_paging_gprs_active.py:38: start network... 05:43:24.741260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:25.258682 run create_hlr_db(pid=13229): Launched 05:43:25.394208 bus /gobi_6: Setting Powered False 05:43:26.459463 run create_hlr_db(pid=13229): Terminated: ok {rc=0} 05:43:26.905836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13231): Launched 05:43:27.220246 run osmo-hlr_10.42.42.2(pid=13232): Launched 05:43:27.340034 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:27.881132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13234): Launched 05:43:28.194786 run osmo-stp_10.42.42.5(pid=13235): Launched 05:43:28.314234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:28.852897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13237): Launched 05:43:28.973104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:29.238406 run patchelf(pid=13238): Launched 05:43:29.411872 run osmo-stp_10.42.42.5(pid=13235): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13235)] 05:43:29.544188 run osmo-stp_10.42.42.5(pid=13235): stdout: | (launched: 2022-12-14_05:43:28.136881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:29.678593 run osmo-stp_10.42.42.5(pid=13235): stderr: | 20221214054328308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054328308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054328308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054328309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054328309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054328309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054328309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:29.812634 run osmo-stp_10.42.42.5(pid=13235): stdout: | (launched: 2022-12-14_05:43:28.136881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:29.940397 run osmo-stp_10.42.42.5(pid=13235): stderr: | 20221214054328308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054328308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054328308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054328309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054328309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054328309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054328309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:30.091954 run patchelf(pid=13238): Terminating (SIGINT) 05:43:30.267228 run patchelf(pid=13238): Terminated: ok {rc=0} 05:43:30.394136 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13235): Process ended prematurely: osmo-stp_10.42.42.5(pid=13235) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13235)] [trial-2400↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:43:30.403743 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 05:43:30.430877 run osmo-hlr_10.42.42.2(pid=13232): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13232)] 05:43:30.479160 run osmo-hlr_10.42.42.2(pid=13232): stdout: | (launched: 2022-12-14_05:43:27.162515) 05:43:30.529201 run osmo-hlr_10.42.42.2(pid=13232): stderr: | 20221214054327339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054327339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054327339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054327339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054327339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054327339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054327351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054327359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054327360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054327360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:30.579572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13225): Terminating (SIGTERM) 05:43:30.620095 run iperf3-srv_10.42.42.10(pid=13226): Terminating (SIGTERM) 05:43:30.660526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13227): Terminating (SIGTERM) 05:43:30.700754 run iperf3-srv_10.42.42.10(pid=13228): Terminating (SIGTERM) 05:43:30.741178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13231): Terminating (SIGTERM) 05:43:30.782041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13234): Terminating (SIGTERM) 05:43:30.822309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13237): Terminating (SIGTERM) 05:43:30.889430 --- ParallelTerminationStrategy: PID 13225 died... 05:43:30.914260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13225): Terminated: ok {rc=0} 05:43:30.966751 --- ParallelTerminationStrategy: PID 13226 died... 05:43:30.987917 run iperf3-srv_10.42.42.10(pid=13226): Terminated {rc=256} 05:43:31.040413 --- ParallelTerminationStrategy: PID 13227 died... 05:43:31.060221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13227): Terminated: ok {rc=0} 05:43:31.106444 --- ParallelTerminationStrategy: PID 13228 died... 05:43:31.127055 run iperf3-srv_10.42.42.10(pid=13228): Terminated {rc=256} 05:43:31.173135 --- ParallelTerminationStrategy: PID 13231 died... 05:43:31.193504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13231): Terminated: ok {rc=0} 05:43:31.239703 --- ParallelTerminationStrategy: PID 13234 died... 05:43:31.260408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13234): Terminated: ok {rc=0} 05:43:31.307017 --- ParallelTerminationStrategy: PID 13237 died... 05:43:31.327563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13237): Terminated: ok {rc=0} 05:43:31.415655 bus /gobi_0: Setting Powered False 05:43:32.513967 bus /gobi_0: Setting Powered False 05:43:33.626987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:43:34.777824 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:34.789734 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:34.827566 tst iperf3.py: using LAC 38803 05:43:34.957768 tst iperf3.py: using RAC 43 05:43:35.089712 tst iperf3.py: using CellId 38803 05:43:35.219341 tst iperf3.py: using BVCI 38804 05:43:35.342279 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.353567 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.364541 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.375718 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.386671 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.397659 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.408728 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.419796 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:35.431002 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:35.549286 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:43:35.760842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:36.077990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13239): Launched 05:43:36.350982 run iperf3-srv_10.42.42.10(pid=13240): Launched 05:43:36.467669 tst iperf3.py:8: start network... 05:43:36.676595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:37.159925 run create_hlr_db(pid=13241): Launched 05:43:37.284574 bus /gobi_6: Setting Powered False 05:43:38.346207 run create_hlr_db(pid=13241): Terminated: ok {rc=0} 05:43:38.801105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13243): Launched 05:43:39.132581 run osmo-hlr_10.42.42.2(pid=13244): Launched 05:43:39.258955 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:39.837620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13246): Launched 05:43:40.169823 run osmo-stp_10.42.42.5(pid=13247): Launched 05:43:40.295965 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:40.870592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13249): Launched 05:43:40.998124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:41.279627 run patchelf(pid=13250): Launched 05:43:41.464345 run osmo-stp_10.42.42.5(pid=13247): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13247)] 05:43:41.604560 run osmo-stp_10.42.42.5(pid=13247): stdout: | (launched: 2022-12-14_05:43:40.108794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:41.747132 run osmo-stp_10.42.42.5(pid=13247): stderr: | 20221214054340302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054340302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054340303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054340303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054340304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054340304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054340304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:41.889508 run osmo-stp_10.42.42.5(pid=13247): stdout: | (launched: 2022-12-14_05:43:40.108794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:42.025274 run osmo-stp_10.42.42.5(pid=13247): stderr: | 20221214054340302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054340302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054340303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054340303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054340304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054340304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054340304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:42.186415 run patchelf(pid=13250): Terminating (SIGINT) 05:43:42.372068 run patchelf(pid=13250): Terminated: ok {rc=0} 05:43:42.505850 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13247): Process ended prematurely: osmo-stp_10.42.42.5(pid=13247) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13247)] [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 05:43:42.516225 tst iperf3.py:8: Test FAILED (7.8 sec) 05:43:42.544684 run osmo-hlr_10.42.42.2(pid=13244): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13244)] 05:43:42.595207 run osmo-hlr_10.42.42.2(pid=13244): stdout: | (launched: 2022-12-14_05:43:39.071791) 05:43:42.647489 run osmo-hlr_10.42.42.2(pid=13244): stderr: | 20221214054339272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054339272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054339272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054339272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054339272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054339272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054339285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054339293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054339293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054339293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:42.700689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13239): Terminating (SIGTERM) 05:43:42.743299 run iperf3-srv_10.42.42.10(pid=13240): Terminating (SIGTERM) 05:43:42.786261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13243): Terminating (SIGTERM) 05:43:42.828669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13246): Terminating (SIGTERM) 05:43:42.871626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13249): Terminating (SIGTERM) 05:43:42.914719 --- ParallelTerminationStrategy: PID 13239 died... 05:43:42.934952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13239): Terminated: ok {rc=0} 05:43:42.982116 --- ParallelTerminationStrategy: PID 13240 died... 05:43:43.002062 run iperf3-srv_10.42.42.10(pid=13240): Terminated {rc=256} 05:43:43.048812 --- ParallelTerminationStrategy: PID 13243 died... 05:43:43.069329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13243): Terminated: ok {rc=0} 05:43:43.115934 --- ParallelTerminationStrategy: PID 13246 died... 05:43:43.136022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13246): Terminated: ok {rc=0} 05:43:43.182924 --- ParallelTerminationStrategy: PID 13249 died... 05:43:43.202920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13249): Terminated: ok {rc=0} 05:43:43.292034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:43:44.442058 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:44.453693 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:44.490445 tst iperf3m4.py: using LAC 38804 05:43:44.612702 tst iperf3m4.py: using RAC 44 05:43:44.736199 tst iperf3m4.py: using CellId 38804 05:43:44.859797 tst iperf3m4.py: using BVCI 38805 05:43:44.974490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:44.985580 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:44.996449 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.007297 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.018376 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.029352 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.040575 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.051540 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.062688 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:45.187481 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:45.306439 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:45.427594 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:45.547810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:43:45.773392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:46.131706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13251): Launched 05:43:46.437712 run iperf3-srv_10.42.42.10(pid=13252): Launched 05:43:46.566035 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:43:46.794865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:47.141695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13253): Launched 05:43:47.433328 run iperf3-srv_10.42.42.10(pid=13254): Launched 05:43:47.557493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:43:47.781275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:48.115383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13255): Launched 05:43:48.404940 run iperf3-srv_10.42.42.10(pid=13256): Launched 05:43:48.528942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:43:48.752716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:49.086897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13257): Launched 05:43:49.376734 run iperf3-srv_10.42.42.10(pid=13258): Launched 05:43:49.501569 tst iperf3m4.py:8: start network... 05:43:49.725168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:50.240144 run create_hlr_db(pid=13259): Launched 05:43:50.375335 bus /gobi_6: Setting Powered False 05:43:51.440670 run create_hlr_db(pid=13259): Terminated: ok {rc=0} 05:43:51.885627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13261): Launched 05:43:52.199297 run osmo-hlr_10.42.42.2(pid=13262): Launched 05:43:52.318690 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:52.868745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13264): Launched 05:43:53.180245 run osmo-stp_10.42.42.5(pid=13265): Launched 05:43:53.298892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:53.837030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13267): Launched 05:43:53.958088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:54.223678 run patchelf(pid=13268): Launched 05:43:54.397417 run osmo-stp_10.42.42.5(pid=13265): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13265)] 05:43:54.529566 run osmo-stp_10.42.42.5(pid=13265): stdout: | (launched: 2022-12-14_05:43:53.122930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:54.663757 run osmo-stp_10.42.42.5(pid=13265): stderr: | 20221214054353291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054353292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054353292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054353292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054353293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054353293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054353293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:54.798264 run osmo-stp_10.42.42.5(pid=13265): stdout: | (launched: 2022-12-14_05:43:53.122930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:54.925958 run osmo-stp_10.42.42.5(pid=13265): stderr: | 20221214054353291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054353292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054353292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054353292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054353293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054353293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054353293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:55.077292 run patchelf(pid=13268): Terminating (SIGINT) 05:43:55.251940 run patchelf(pid=13268): Terminated: ok {rc=0} 05:43:55.378362 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13265): Process ended prematurely: osmo-stp_10.42.42.5(pid=13265) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13265)] [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 05:43:55.387987 tst iperf3m4.py:8: Test FAILED (11.0 sec) 05:43:55.415313 run osmo-hlr_10.42.42.2(pid=13262): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13262)] 05:43:55.464469 run osmo-hlr_10.42.42.2(pid=13262): stdout: | (launched: 2022-12-14_05:43:52.141531) 05:43:55.514269 run osmo-hlr_10.42.42.2(pid=13262): stderr: | 20221214054352315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054352315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054352315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054352315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054352315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054352315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054352331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054352340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054352341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054352341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:55.564581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13251): Terminating (SIGTERM) 05:43:55.605101 run iperf3-srv_10.42.42.10(pid=13252): Terminating (SIGTERM) 05:43:55.645298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13253): Terminating (SIGTERM) 05:43:55.685969 run iperf3-srv_10.42.42.10(pid=13254): Terminating (SIGTERM) 05:43:55.726042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13255): Terminating (SIGTERM) 05:43:55.766100 run iperf3-srv_10.42.42.10(pid=13256): Terminating (SIGTERM) 05:43:55.806138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13257): Terminating (SIGTERM) 05:43:55.846363 run iperf3-srv_10.42.42.10(pid=13258): Terminating (SIGTERM) 05:43:55.886476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13261): Terminating (SIGTERM) 05:43:55.926565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13264): Terminating (SIGTERM) 05:43:55.966810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13267): Terminating (SIGTERM) 05:43:56.007063 --- ParallelTerminationStrategy: PID 13251 died... 05:43:56.026610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13251): Terminated: ok {rc=0} 05:43:56.071390 --- ParallelTerminationStrategy: PID 13252 died... 05:43:56.090623 run iperf3-srv_10.42.42.10(pid=13252): Terminated {rc=256} 05:43:56.135073 --- ParallelTerminationStrategy: PID 13253 died... 05:43:56.154260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13253): Terminated: ok {rc=0} 05:43:56.198612 --- ParallelTerminationStrategy: PID 13254 died... 05:43:56.217749 run iperf3-srv_10.42.42.10(pid=13254): Terminated {rc=256} 05:43:56.261894 --- ParallelTerminationStrategy: PID 13255 died... 05:43:56.280880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13255): Terminated: ok {rc=0} 05:43:56.325150 --- ParallelTerminationStrategy: PID 13256 died... 05:43:56.344121 run iperf3-srv_10.42.42.10(pid=13256): Terminated {rc=256} 05:43:56.388454 --- ParallelTerminationStrategy: PID 13257 died... 05:43:56.407425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13257): Terminated: ok {rc=0} 05:43:56.451730 --- ParallelTerminationStrategy: PID 13258 died... 05:43:56.470913 run iperf3-srv_10.42.42.10(pid=13258): Terminated {rc=256} 05:43:56.515160 --- ParallelTerminationStrategy: PID 13261 died... 05:43:56.534185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13261): Terminated: ok {rc=0} 05:43:56.578474 --- ParallelTerminationStrategy: PID 13264 died... 05:43:56.598017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13264): Terminated: ok {rc=0} 05:43:56.642415 --- ParallelTerminationStrategy: PID 13267 died... 05:43:56.661666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13267): Terminated: ok {rc=0} 05:43:56.750942 bus /gobi_4: Setting Powered False 05:43:57.846736 bus /gobi_4: Setting Powered False 05:43:58.962881 bus /gobi_1: Setting Powered False 05:44:00.062623 bus /gobi_1: Setting Powered False 05:44:01.181980 bus /gobi_0: Setting Powered False 05:44:02.279042 bus /gobi_0: Setting Powered False 05:44:03.395677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 05:44:04.499906 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:04.511883 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:44:04.550135 tst ping.py: using LAC 38805 05:44:04.673979 tst ping.py: using RAC 45 05:44:04.796892 tst ping.py: using CellId 38805 05:44:04.917940 tst ping.py: using BVCI 38806 05:44:05.029792 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.040507 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.051199 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.061747 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.072126 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.082890 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.094229 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:05.105182 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:44:05.226013 tst ping.py:19: start network... 05:44:05.446845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:05.951056 run create_hlr_db(pid=13269): Launched 05:44:06.082859 bus /gobi_6: Setting Powered False 05:44:07.146851 run create_hlr_db(pid=13269): Terminated: ok {rc=0} 05:44:07.585600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13271): Launched 05:44:07.891600 run osmo-hlr_10.42.42.2(pid=13272): Launched 05:44:08.008324 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:08.553929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13274): Launched 05:44:08.860117 run osmo-stp_10.42.42.5(pid=13275): Launched 05:44:08.976917 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:09.505178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13277): Launched 05:44:09.622854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:09.882220 run patchelf(pid=13278): Launched 05:44:10.052393 run osmo-stp_10.42.42.5(pid=13275): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13275)] 05:44:10.182641 run osmo-stp_10.42.42.5(pid=13275): stdout: | (launched: 2022-12-14_05:44:08.803702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:10.314040 run osmo-stp_10.42.42.5(pid=13275): stderr: | 20221214054408975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054408975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054408976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054408976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054408977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054408977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054408977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:10.445831 run osmo-stp_10.42.42.5(pid=13275): stdout: | (launched: 2022-12-14_05:44:08.803702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:10.571004 run osmo-stp_10.42.42.5(pid=13275): stderr: | 20221214054408975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054408975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054408976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054408976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054408977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054408977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054408977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:10.720073 run patchelf(pid=13278): Terminating (SIGINT) 05:44:10.891500 run patchelf(pid=13278): Terminated: ok {rc=0} 05:44:11.015265 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13275): Process ended prematurely: osmo-stp_10.42.42.5(pid=13275) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13275)] [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 05:44:11.024277 tst ping.py:22: Test FAILED (6.5 sec) 05:44:11.050952 run osmo-hlr_10.42.42.2(pid=13272): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13272)] 05:44:11.099229 run osmo-hlr_10.42.42.2(pid=13272): stdout: | (launched: 2022-12-14_05:44:07.835055) 05:44:11.149201 run osmo-hlr_10.42.42.2(pid=13272): stderr: | 20221214054408010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054408010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054408010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054408010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054408010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054408010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054408023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054408032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054408032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054408032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:11.199210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13271): Terminating (SIGTERM) 05:44:11.239722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13274): Terminating (SIGTERM) 05:44:11.279970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13277): Terminating (SIGTERM) 05:44:11.320625 --- ParallelTerminationStrategy: PID 13271 died... 05:44:11.340467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13271): Terminated: ok {rc=0} 05:44:11.385172 --- ParallelTerminationStrategy: PID 13274 died... 05:44:11.404295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13274): Terminated: ok {rc=0} 05:44:11.448462 --- ParallelTerminationStrategy: PID 13277 died... 05:44:11.467545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13277): Terminated: ok {rc=0} 05:44:11.551999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:44:12.637057 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:12.648735 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:44:12.686575 tst ping_idle_ping.py: using LAC 38806 05:44:12.816354 tst ping_idle_ping.py: using RAC 46 05:44:12.944419 tst ping_idle_ping.py: using CellId 38806 05:44:13.066455 tst ping_idle_ping.py: using BVCI 38807 05:44:13.180298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.191386 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.202448 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.213385 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.224621 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.235840 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.247219 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:44:13.258624 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:44:13.376369 tst ping_idle_ping.py:24: start network... 05:44:13.583571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:14.062911 run create_hlr_db(pid=13279): Launched 05:44:14.180158 bus /gobi_6: Setting Powered False 05:44:15.241130 run create_hlr_db(pid=13279): Terminated: ok {rc=0} 05:44:15.690795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Launched 05:44:16.016638 run osmo-hlr_10.42.42.2(pid=13282): Launched 05:44:16.378742 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:17.015030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Launched 05:44:17.360473 run osmo-stp_10.42.42.5(pid=13285): Launched 05:44:17.487474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:18.053538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13287): Launched 05:44:18.178945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:18.456614 run patchelf(pid=13288): Launched 05:44:18.638537 run osmo-stp_10.42.42.5(pid=13285): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] 05:44:18.776194 run osmo-stp_10.42.42.5(pid=13285): stdout: | (launched: 2022-12-14_05:44:17.299354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:18.915809 run osmo-stp_10.42.42.5(pid=13285): stderr: | 20221214054417494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054417494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054417494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054417495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054417495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054417495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054417495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:19.055808 run osmo-stp_10.42.42.5(pid=13285): stdout: | (launched: 2022-12-14_05:44:17.299354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:19.189694 run osmo-stp_10.42.42.5(pid=13285): stderr: | 20221214054417494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054417494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054417494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054417495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054417495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054417495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054417495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:19.348720 run patchelf(pid=13288): Terminating (SIGINT) 05:44:19.531115 run patchelf(pid=13288): Terminated: ok {rc=0} 05:44:19.663108 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13285): Process ended prematurely: osmo-stp_10.42.42.5(pid=13285) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 05:44:19.672745 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 05:44:19.700793 run osmo-hlr_10.42.42.2(pid=13282): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13282)] 05:44:19.750970 run osmo-hlr_10.42.42.2(pid=13282): stdout: | (launched: 2022-12-14_05:44:15.954973) 05:44:19.802968 run osmo-hlr_10.42.42.2(pid=13282): stderr: | 20221214054416199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054416200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054416200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054416200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054416200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054416200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054416218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054416240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054416240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054416240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:19.855243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Terminating (SIGTERM) 05:44:19.897390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Terminating (SIGTERM) 05:44:19.939670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13287): Terminating (SIGTERM) 05:44:19.982398 --- ParallelTerminationStrategy: PID 13281 died... 05:44:20.002641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Terminated: ok {rc=0} 05:44:20.049161 --- ParallelTerminationStrategy: PID 13284 died... 05:44:20.068766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Terminated: ok {rc=0} 05:44:20.114958 --- ParallelTerminationStrategy: PID 13287 died... 05:44:20.134654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13287): Terminated: ok {rc=0} 05:44:20.222264 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:44:21.517444 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:44:21.523787 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:44:21.544767 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:44:21.584026 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:44:21.675423 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:44:21.696726 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:44:21.735643 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:44:22.323663 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:44:22.375195 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.386215 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:22.442445 tst cs_paging_gprs_active.py: using LAC 38807 05:44:22.567029 tst cs_paging_gprs_active.py: using RAC 47 05:44:22.699881 tst cs_paging_gprs_active.py: using CellId 38807 05:44:22.834842 tst cs_paging_gprs_active.py: using BVCI 38808 05:44:22.956466 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.968035 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.979183 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.990321 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:23.001394 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:23.012461 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:23.023747 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:23.034797 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:23.046065 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:23.164044 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:23.285251 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:44:23.512005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:23.848629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13293): Launched 05:44:24.140080 run iperf3-srv_10.42.42.10(pid=13294): Launched 05:44:24.266004 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:44:24.492790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:24.829332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13295): Launched 05:44:25.120512 run iperf3-srv_10.42.42.10(pid=13296): Launched 05:44:25.245850 tst cs_paging_gprs_active.py:38: start network... 05:44:25.472443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:25.990868 run create_hlr_db(pid=13297): Launched 05:44:26.124636 bus /gobi_6: Setting Powered False 05:44:27.190027 run create_hlr_db(pid=13297): Terminated: ok {rc=0} 05:44:27.637694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13299): Launched 05:44:27.952630 run osmo-hlr_10.42.42.2(pid=13300): Launched 05:44:28.073196 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:28.629399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13302): Launched 05:44:28.942999 run osmo-stp_10.42.42.5(pid=13303): Launched 05:44:29.062959 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:29.602581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13305): Launched 05:44:29.723976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:29.990204 run patchelf(pid=13306): Launched 05:44:30.164392 run osmo-stp_10.42.42.5(pid=13303): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13303)] 05:44:30.297188 run osmo-stp_10.42.42.5(pid=13303): stdout: | (launched: 2022-12-14_05:44:28.885508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:30.432440 run osmo-stp_10.42.42.5(pid=13303): stderr: | 20221214054429057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054429057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054429057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054429058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054429058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054429058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054429058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:30.567460 run osmo-stp_10.42.42.5(pid=13303): stdout: | (launched: 2022-12-14_05:44:28.885508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:30.695742 run osmo-stp_10.42.42.5(pid=13303): stderr: | 20221214054429057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054429057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054429057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054429058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054429058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054429058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054429058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:30.852653 run patchelf(pid=13306): Terminating (SIGINT) 05:44:31.068029 run patchelf(pid=13306): Terminated: ok {rc=0} 05:44:31.206354 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13303): Process ended prematurely: osmo-stp_10.42.42.5(pid=13303) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13303)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:44:31.217736 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:44:31.247015 run osmo-hlr_10.42.42.2(pid=13300): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13300)] 05:44:31.298759 run osmo-hlr_10.42.42.2(pid=13300): stdout: | (launched: 2022-12-14_05:44:27.894593) 05:44:31.353419 run osmo-hlr_10.42.42.2(pid=13300): stderr: | 20221214054428072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054428072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054428072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054428072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054428072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054428072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054428085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054428093 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054428093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054428093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:31.408553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13293): Terminating (SIGTERM) 05:44:31.452123 run iperf3-srv_10.42.42.10(pid=13294): Terminating (SIGTERM) 05:44:31.495337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13295): Terminating (SIGTERM) 05:44:31.538928 run iperf3-srv_10.42.42.10(pid=13296): Terminating (SIGTERM) 05:44:31.584461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13299): Terminating (SIGTERM) 05:44:31.628211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13302): Terminating (SIGTERM) 05:44:31.674201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13305): Terminating (SIGTERM) 05:44:31.719638 --- ParallelTerminationStrategy: PID 13293 died... 05:44:31.740622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13293): Terminated: ok {rc=0} 05:44:31.790878 --- ParallelTerminationStrategy: PID 13294 died... 05:44:31.811203 run iperf3-srv_10.42.42.10(pid=13294): Terminated {rc=256} 05:44:31.858152 --- ParallelTerminationStrategy: PID 13295 died... 05:44:31.878418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13295): Terminated: ok {rc=0} 05:44:31.925872 --- ParallelTerminationStrategy: PID 13296 died... 05:44:31.946409 run iperf3-srv_10.42.42.10(pid=13296): Terminated {rc=256} 05:44:31.994912 --- ParallelTerminationStrategy: PID 13299 died... 05:44:32.015334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13299): Terminated: ok {rc=0} 05:44:32.062798 --- ParallelTerminationStrategy: PID 13302 died... 05:44:32.083099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13302): Terminated: ok {rc=0} 05:44:32.138407 --- ParallelTerminationStrategy: PID 13305 died... 05:44:32.158678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13305): Terminated: ok {rc=0} 05:44:32.248312 bus /gobi_0: Setting Powered False 05:44:33.348806 bus /gobi_0: Setting Powered False 05:44:34.464353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:44:35.616136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:35.628133 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:35.688932 tst iperf3.py: using LAC 38808 05:44:35.820663 tst iperf3.py: using RAC 48 05:44:35.950565 tst iperf3.py: using CellId 38808 05:44:36.080700 tst iperf3.py: using BVCI 38809 05:44:36.201940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.213369 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.224367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.235454 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.246485 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.257672 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.269375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.280439 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.291685 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:36.408331 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:44:36.621516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:36.938535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13307): Launched 05:44:37.212529 run iperf3-srv_10.42.42.10(pid=13308): Launched 05:44:37.331235 tst iperf3.py:8: start network... 05:44:37.542858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:38.029239 run create_hlr_db(pid=13309): Launched 05:44:38.149929 bus /gobi_6: Setting Powered False 05:44:39.212085 run create_hlr_db(pid=13309): Terminated: ok {rc=0} 05:44:39.667754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13311): Launched 05:44:40.001893 run osmo-hlr_10.42.42.2(pid=13312): Launched 05:44:40.128854 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:40.702715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13314): Launched 05:44:41.034744 run osmo-stp_10.42.42.5(pid=13315): Launched 05:44:41.161809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:41.735471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13317): Launched 05:44:41.863168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:42.144379 run patchelf(pid=13318): Launched 05:44:42.328530 run osmo-stp_10.42.42.5(pid=13315): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13315)] 05:44:42.468884 run osmo-stp_10.42.42.5(pid=13315): stdout: | (launched: 2022-12-14_05:44:40.974244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:42.611612 run osmo-stp_10.42.42.5(pid=13315): stderr: | 20221214054441166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054441167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054441167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054441167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054441168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054441168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054441168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:42.753922 run osmo-stp_10.42.42.5(pid=13315): stdout: | (launched: 2022-12-14_05:44:40.974244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:42.889986 run osmo-stp_10.42.42.5(pid=13315): stderr: | 20221214054441166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054441167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054441167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054441167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054441168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054441168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054441168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:43.051026 run patchelf(pid=13318): Terminating (SIGINT) 05:44:43.236344 run patchelf(pid=13318): Terminated: ok {rc=0} 05:44:43.371152 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13315): Process ended prematurely: osmo-stp_10.42.42.5(pid=13315) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13315)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 05:44:43.381552 tst iperf3.py:8: Test FAILED (7.8 sec) 05:44:43.409891 run osmo-hlr_10.42.42.2(pid=13312): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13312)] 05:44:43.460054 run osmo-hlr_10.42.42.2(pid=13312): stdout: | (launched: 2022-12-14_05:44:39.940281) 05:44:43.512335 run osmo-hlr_10.42.42.2(pid=13312): stderr: | 20221214054440139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054440139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054440139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054440139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054440139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054440139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054440151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054440160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054440160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054440160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:43.564730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13307): Terminating (SIGTERM) 05:44:43.606642 run iperf3-srv_10.42.42.10(pid=13308): Terminating (SIGTERM) 05:44:43.648459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13311): Terminating (SIGTERM) 05:44:43.690579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13314): Terminating (SIGTERM) 05:44:43.732776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13317): Terminating (SIGTERM) 05:44:43.775320 --- ParallelTerminationStrategy: PID 13307 died... 05:44:43.795416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13307): Terminated: ok {rc=0} 05:44:43.842855 --- ParallelTerminationStrategy: PID 13308 died... 05:44:43.862669 run iperf3-srv_10.42.42.10(pid=13308): Terminated {rc=256} 05:44:43.908763 --- ParallelTerminationStrategy: PID 13311 died... 05:44:43.928481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13311): Terminated: ok {rc=0} 05:44:43.974626 --- ParallelTerminationStrategy: PID 13314 died... 05:44:43.994193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13314): Terminated: ok {rc=0} 05:44:44.040523 --- ParallelTerminationStrategy: PID 13317 died... 05:44:44.060348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13317): Terminated: ok {rc=0} 05:44:44.149547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:44:45.301180 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.313187 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:45.370918 tst iperf3m4.py: using LAC 38809 05:44:45.500238 tst iperf3m4.py: using RAC 49 05:44:45.628883 tst iperf3m4.py: using CellId 38809 05:44:45.759686 tst iperf3m4.py: using BVCI 38810 05:44:45.905644 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.917783 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.929579 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.941413 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.955009 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.967897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.981911 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.994775 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:46.007561 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:46.136870 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:46.286151 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:46.431760 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:46.578166 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:44:46.861175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:47.226799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13319): Launched 05:44:47.530157 run iperf3-srv_10.42.42.10(pid=13320): Launched 05:44:47.654928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:44:47.879319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:48.214765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13321): Launched 05:44:48.505257 run iperf3-srv_10.42.42.10(pid=13322): Launched 05:44:48.629694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:44:48.853572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:49.187780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13323): Launched 05:44:49.478154 run iperf3-srv_10.42.42.10(pid=13324): Launched 05:44:49.602981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:44:49.827269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:50.163327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13325): Launched 05:44:50.453553 run iperf3-srv_10.42.42.10(pid=13326): Launched 05:44:50.577863 tst iperf3m4.py:8: start network... 05:44:50.802053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:51.318273 run create_hlr_db(pid=13327): Launched 05:44:51.452103 bus /gobi_6: Setting Powered False 05:44:52.513233 run create_hlr_db(pid=13327): Terminated: ok {rc=0} 05:44:52.976079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13329): Launched 05:44:53.309913 run osmo-hlr_10.42.42.2(pid=13330): Launched 05:44:53.435612 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:54.014252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13332): Launched 05:44:54.348054 run osmo-stp_10.42.42.5(pid=13333): Launched 05:44:54.473942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:55.048645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13335): Launched 05:44:55.175841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:55.459007 run patchelf(pid=13336): Launched 05:44:55.644127 run osmo-stp_10.42.42.5(pid=13333): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13333)] 05:44:55.784500 run osmo-stp_10.42.42.5(pid=13333): stdout: | (launched: 2022-12-14_05:44:54.286778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:55.926849 run osmo-stp_10.42.42.5(pid=13333): stderr: | 20221214054454477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054454477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054454477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054454477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054454478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054454478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054454478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:56.069277 run osmo-stp_10.42.42.5(pid=13333): stdout: | (launched: 2022-12-14_05:44:54.286778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:56.205023 run osmo-stp_10.42.42.5(pid=13333): stderr: | 20221214054454477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054454477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054454477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054454477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054454478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054454478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054454478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:56.366746 run patchelf(pid=13336): Terminating (SIGINT) 05:44:56.552816 run patchelf(pid=13336): Terminated: ok {rc=0} 05:44:56.686572 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13333): Process ended prematurely: osmo-stp_10.42.42.5(pid=13333) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13333)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:44:56.696692 tst iperf3m4.py:8: Test FAILED (11.4 sec) 05:44:56.725834 run osmo-hlr_10.42.42.2(pid=13330): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13330)] 05:44:56.776707 run osmo-hlr_10.42.42.2(pid=13330): stdout: | (launched: 2022-12-14_05:44:53.248395) 05:44:56.829250 run osmo-hlr_10.42.42.2(pid=13330): stderr: | 20221214054453447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054453447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054453447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054453447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054453447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054453447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054453458 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054453467 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054453467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054453467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:56.881978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13319): Terminating (SIGTERM) 05:44:56.924252 run iperf3-srv_10.42.42.10(pid=13320): Terminating (SIGTERM) 05:44:56.966546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13321): Terminating (SIGTERM) 05:44:57.008937 run iperf3-srv_10.42.42.10(pid=13322): Terminating (SIGTERM) 05:44:57.051589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13323): Terminating (SIGTERM) 05:44:57.094501 run iperf3-srv_10.42.42.10(pid=13324): Terminating (SIGTERM) 05:44:57.136864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13325): Terminating (SIGTERM) 05:44:57.179679 run iperf3-srv_10.42.42.10(pid=13326): Terminating (SIGTERM) 05:44:57.221880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13329): Terminating (SIGTERM) 05:44:57.264759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13332): Terminating (SIGTERM) 05:44:57.307208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13335): Terminating (SIGTERM) 05:44:57.350119 --- ParallelTerminationStrategy: PID 13319 died... 05:44:57.370350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13319): Terminated: ok {rc=0} 05:44:57.417333 --- ParallelTerminationStrategy: PID 13320 died... 05:44:57.437063 run iperf3-srv_10.42.42.10(pid=13320): Terminated {rc=256} 05:44:57.483603 --- ParallelTerminationStrategy: PID 13321 died... 05:44:57.503440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13321): Terminated: ok {rc=0} 05:44:57.550290 --- ParallelTerminationStrategy: PID 13322 died... 05:44:57.570225 run iperf3-srv_10.42.42.10(pid=13322): Terminated {rc=256} 05:44:57.616872 --- ParallelTerminationStrategy: PID 13323 died... 05:44:57.636763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13323): Terminated: ok {rc=0} 05:44:57.683423 --- ParallelTerminationStrategy: PID 13324 died... 05:44:57.703223 run iperf3-srv_10.42.42.10(pid=13324): Terminated {rc=256} 05:44:57.749808 --- ParallelTerminationStrategy: PID 13325 died... 05:44:57.769641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13325): Terminated: ok {rc=0} 05:44:57.816249 --- ParallelTerminationStrategy: PID 13326 died... 05:44:57.836170 run iperf3-srv_10.42.42.10(pid=13326): Terminated {rc=256} 05:44:57.882768 --- ParallelTerminationStrategy: PID 13329 died... 05:44:57.902671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13329): Terminated: ok {rc=0} 05:44:57.949802 --- ParallelTerminationStrategy: PID 13332 died... 05:44:57.969947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13332): Terminated: ok {rc=0} 05:44:58.016496 --- ParallelTerminationStrategy: PID 13335 died... 05:44:58.036505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13335): Terminated: ok {rc=0} 05:44:58.125477 bus /gobi_4: Setting Powered False 05:44:59.225732 bus /gobi_4: Setting Powered False 05:45:00.341666 bus /gobi_1: Setting Powered False 05:45:01.461384 bus /gobi_1: Setting Powered False 05:45:02.594959 bus /gobi_0: Setting Powered False 05:45:03.695136 bus /gobi_0: Setting Powered False 05:45:04.814616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:45:05.919851 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:05.931872 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:45:05.990310 tst ping.py: using LAC 38810 05:45:06.119174 tst ping.py: using RAC 50 05:45:06.249347 tst ping.py: using CellId 38810 05:45:06.379623 tst ping.py: using BVCI 38811 05:45:06.500369 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.511804 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.522964 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.534116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.545235 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.556224 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.567538 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:06.578674 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:45:06.698088 tst ping.py:19: start network... 05:45:06.920538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:07.427749 run create_hlr_db(pid=13348): Launched 05:45:07.559195 bus /gobi_6: Setting Powered False 05:45:08.621604 run create_hlr_db(pid=13348): Terminated: ok {rc=0} 05:45:09.077180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13350): Launched 05:45:09.406442 run osmo-hlr_10.42.42.2(pid=13351): Launched 05:45:09.531611 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:10.100214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13353): Launched 05:45:10.427060 run osmo-stp_10.42.42.5(pid=13354): Launched 05:45:10.551656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:11.119135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13356): Launched 05:45:11.243870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:11.522120 run patchelf(pid=13357): Launched 05:45:11.705771 run osmo-stp_10.42.42.5(pid=13354): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13354)] 05:45:11.844025 run osmo-stp_10.42.42.5(pid=13354): stdout: | (launched: 2022-12-14_05:45:10.367285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:11.986448 run osmo-stp_10.42.42.5(pid=13354): stderr: | 20221214054510559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054510559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054510559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054510560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054510560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054510560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054510560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:12.130341 run osmo-stp_10.42.42.5(pid=13354): stdout: | (launched: 2022-12-14_05:45:10.367285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:12.267473 run osmo-stp_10.42.42.5(pid=13354): stderr: | 20221214054510559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054510559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054510559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054510560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054510560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054510560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054510560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:12.430601 run patchelf(pid=13357): Terminating (SIGINT) 05:45:12.616758 run patchelf(pid=13357): Terminated: ok {rc=0} 05:45:12.751400 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13354): Process ended prematurely: osmo-stp_10.42.42.5(pid=13354) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13354)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 05:45:12.761245 tst ping.py:22: Test FAILED (6.8 sec) 05:45:12.790947 run osmo-hlr_10.42.42.2(pid=13351): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13351)] 05:45:12.844699 run osmo-hlr_10.42.42.2(pid=13351): stdout: | (launched: 2022-12-14_05:45:09.346319) 05:45:12.899827 run osmo-hlr_10.42.42.2(pid=13351): stderr: | 20221214054509545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054509545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054509545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054509545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054509545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054509545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054509568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054509579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054509579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054509579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:12.953997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13350): Terminating (SIGTERM) 05:45:12.998060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13353): Terminating (SIGTERM) 05:45:13.044138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13356): Terminating (SIGTERM) 05:45:13.090010 --- ParallelTerminationStrategy: PID 13350 died... 05:45:13.111706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13350): Terminated: ok {rc=0} 05:45:13.161010 --- ParallelTerminationStrategy: PID 13353 died... 05:45:13.183252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13353): Terminated: ok {rc=0} 05:45:13.230920 --- ParallelTerminationStrategy: PID 13356 died... 05:45:13.252341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13356): Terminated: ok {rc=0} 05:45:13.343789 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:45:14.431402 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:14.443100 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:45:14.502621 tst ping_idle_ping.py: using LAC 38811 05:45:14.625985 tst ping_idle_ping.py: using RAC 51 05:45:14.747392 tst ping_idle_ping.py: using CellId 38811 05:45:14.871039 tst ping_idle_ping.py: using BVCI 38812 05:45:14.985650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:14.996462 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:15.007119 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:15.017761 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:15.028620 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:15.040292 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:15.052129 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:45:15.063426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:45:15.179814 tst ping_idle_ping.py:24: start network... 05:45:15.390806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:15.883168 run create_hlr_db(pid=13709): Launched 05:45:16.055694 bus /gobi_6: Setting Powered False 05:45:17.138928 run create_hlr_db(pid=13709): Terminated: ok {rc=0} 05:45:17.601828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Launched 05:45:17.911360 run osmo-hlr_10.42.42.2(pid=13712): Launched 05:45:18.029455 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:18.569742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Launched 05:45:18.878701 run osmo-stp_10.42.42.5(pid=13715): Launched 05:45:18.996769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:19.531019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13717): Launched 05:45:19.649481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:19.910616 run patchelf(pid=13718): Launched 05:45:20.082516 run osmo-stp_10.42.42.5(pid=13715): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] 05:45:20.213993 run osmo-stp_10.42.42.5(pid=13715): stdout: | (launched: 2022-12-14_05:45:18.821435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:20.347280 run osmo-stp_10.42.42.5(pid=13715): stderr: | 20221214054518993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054518993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054518994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054518994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054518995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054518995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054518995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:20.480458 run osmo-stp_10.42.42.5(pid=13715): stdout: | (launched: 2022-12-14_05:45:18.821435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:20.607227 run osmo-stp_10.42.42.5(pid=13715): stderr: | 20221214054518993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054518993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054518994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054518994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054518995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054518995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054518995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:20.757727 run patchelf(pid=13718): Terminating (SIGINT) 05:45:20.930856 run patchelf(pid=13718): Terminated: ok {rc=0} 05:45:21.056008 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13715): Process ended prematurely: osmo-stp_10.42.42.5(pid=13715) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:45:21.065065 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:45:21.091809 run osmo-hlr_10.42.42.2(pid=13712): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13712)] 05:45:21.140396 run osmo-hlr_10.42.42.2(pid=13712): stdout: | (launched: 2022-12-14_05:45:17.854453) 05:45:21.190398 run osmo-hlr_10.42.42.2(pid=13712): stderr: | 20221214054518031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054518031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054518031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054518031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054518031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054518031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054518043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054518052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054518052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054518052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:21.240759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Terminating (SIGTERM) 05:45:21.281341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Terminating (SIGTERM) 05:45:21.321788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13717): Terminating (SIGTERM) 05:45:21.362761 --- ParallelTerminationStrategy: PID 13711 died... 05:45:21.382567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Terminated: ok {rc=0} 05:45:21.427305 --- ParallelTerminationStrategy: PID 13714 died... 05:45:21.446617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Terminated: ok {rc=0} 05:45:21.491382 --- ParallelTerminationStrategy: PID 13717 died... 05:45:21.510798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13717): Terminated: ok {rc=0} 05:45:21.597807 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:45:22.900646 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:45:22.907498 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:45:22.929743 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:45:22.975711 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:45:23.064582 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:45:23.087639 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:45:23.128861 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:45:23.730763 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:45:23.785807 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:23.797633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:23.861619 tst cs_paging_gprs_active.py: using LAC 38812 05:45:23.994989 tst cs_paging_gprs_active.py: using RAC 52 05:45:24.124455 tst cs_paging_gprs_active.py: using CellId 38812 05:45:24.256258 tst cs_paging_gprs_active.py: using BVCI 38813 05:45:24.381228 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.393455 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.405537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.417427 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.429689 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.441850 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.454344 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.466395 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:24.478658 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:24.605640 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:24.729812 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:45:24.961528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:25.306384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13899): Launched 05:45:25.617170 run iperf3-srv_10.42.42.10(pid=13900): Launched 05:45:25.757301 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:45:25.988236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:26.329724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13901): Launched 05:45:26.637544 run iperf3-srv_10.42.42.10(pid=13902): Launched 05:45:26.778828 tst cs_paging_gprs_active.py:38: start network... 05:45:27.009389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:27.542251 run create_hlr_db(pid=13903): Launched 05:45:27.716394 bus /gobi_6: Setting Powered False 05:45:28.777456 run create_hlr_db(pid=13903): Terminated: ok {rc=0} 05:45:29.252830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13906): Launched 05:45:29.591572 run osmo-hlr_10.42.42.2(pid=13907): Launched 05:45:29.721529 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:30.266823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13909): Launched 05:45:30.583762 run osmo-stp_10.42.42.5(pid=13910): Launched 05:45:30.704808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:31.341670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13912): Launched 05:45:31.469808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:31.743697 run patchelf(pid=13913): Launched 05:45:31.937294 run osmo-stp_10.42.42.5(pid=13910): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13910)] 05:45:32.074590 run osmo-stp_10.42.42.5(pid=13910): stdout: | (launched: 2022-12-14_05:45:30.525564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:32.213550 run osmo-stp_10.42.42.5(pid=13910): stderr: | 20221214054530701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054530701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054530702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054530702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054530702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054530703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054530703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:32.351176 run osmo-stp_10.42.42.5(pid=13910): stdout: | (launched: 2022-12-14_05:45:30.525564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:32.480923 run osmo-stp_10.42.42.5(pid=13910): stderr: | 20221214054530701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054530701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054530702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054530702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054530702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054530703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054530703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:32.635223 run patchelf(pid=13913): Terminating (SIGINT) 05:45:32.813460 run patchelf(pid=13913): Terminated: ok {rc=0} 05:45:32.942277 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13910): Process ended prematurely: osmo-stp_10.42.42.5(pid=13910) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13910)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:45:32.952130 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 05:45:32.979447 run osmo-hlr_10.42.42.2(pid=13907): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13907)] 05:45:33.028705 run osmo-hlr_10.42.42.2(pid=13907): stdout: | (launched: 2022-12-14_05:45:29.530024) 05:45:33.079064 run osmo-hlr_10.42.42.2(pid=13907): stderr: | 20221214054529713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054529713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054529713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054529713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054529713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054529713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054529729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054529737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054529737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054529737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:33.129650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13899): Terminating (SIGTERM) 05:45:33.170368 run iperf3-srv_10.42.42.10(pid=13900): Terminating (SIGTERM) 05:45:33.210909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13901): Terminating (SIGTERM) 05:45:33.251880 run iperf3-srv_10.42.42.10(pid=13902): Terminating (SIGTERM) 05:45:33.292419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13906): Terminating (SIGTERM) 05:45:33.333549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13909): Terminating (SIGTERM) 05:45:33.374280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13912): Terminating (SIGTERM) 05:45:33.415079 --- ParallelTerminationStrategy: PID 13899 died... 05:45:33.434600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13899): Terminated: ok {rc=0} 05:45:33.479662 --- ParallelTerminationStrategy: PID 13900 died... 05:45:33.498981 run iperf3-srv_10.42.42.10(pid=13900): Terminated {rc=256} 05:45:33.543591 --- ParallelTerminationStrategy: PID 13901 died... 05:45:33.562870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13901): Terminated: ok {rc=0} 05:45:33.607474 --- ParallelTerminationStrategy: PID 13902 died... 05:45:33.626786 run iperf3-srv_10.42.42.10(pid=13902): Terminated {rc=256} 05:45:33.671429 --- ParallelTerminationStrategy: PID 13906 died... 05:45:33.690844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13906): Terminated: ok {rc=0} 05:45:33.735736 --- ParallelTerminationStrategy: PID 13909 died... 05:45:33.755280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13909): Terminated: ok {rc=0} 05:45:33.800255 --- ParallelTerminationStrategy: PID 13912 died... 05:45:33.819942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13912): Terminated: ok {rc=0} 05:45:33.907577 bus /gobi_0: Setting Powered False 05:45:35.006696 bus /gobi_0: Setting Powered False 05:45:36.123781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:45:37.273532 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.285323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:37.345412 tst iperf3.py: using LAC 38813 05:45:37.479112 tst iperf3.py: using RAC 53 05:45:37.609895 tst iperf3.py: using CellId 38813 05:45:37.741449 tst iperf3.py: using BVCI 38814 05:45:37.862841 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.874452 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.885693 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.896894 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.908035 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.919247 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.930600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.941685 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.952852 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:38.069653 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:45:38.284300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:38.603391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13914): Launched 05:45:38.879397 run iperf3-srv_10.42.42.10(pid=13915): Launched 05:45:38.997819 tst iperf3.py:8: start network... 05:45:39.210739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:39.699654 run create_hlr_db(pid=13916): Launched 05:45:39.819870 bus /gobi_6: Setting Powered False 05:45:40.881594 run create_hlr_db(pid=13916): Terminated: ok {rc=0} 05:45:41.340641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13918): Launched 05:45:41.678680 run osmo-hlr_10.42.42.2(pid=13919): Launched 05:45:41.807588 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:42.385879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13921): Launched 05:45:42.719683 run osmo-stp_10.42.42.5(pid=13922): Launched 05:45:42.847681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:43.427760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13924): Launched 05:45:43.557293 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:43.841709 run patchelf(pid=13925): Launched 05:45:44.027428 run osmo-stp_10.42.42.5(pid=13922): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13922)] 05:45:44.168623 run osmo-stp_10.42.42.5(pid=13922): stdout: | (launched: 2022-12-14_05:45:42.658720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:44.314433 run osmo-stp_10.42.42.5(pid=13922): stderr: | 20221214054542854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054542854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054542854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054542854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054542855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054542855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054542855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:44.458100 run osmo-stp_10.42.42.5(pid=13922): stdout: | (launched: 2022-12-14_05:45:42.658720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:44.594226 run osmo-stp_10.42.42.5(pid=13922): stderr: | 20221214054542854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054542854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054542854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054542854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054542855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054542855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054542855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:44.756037 run patchelf(pid=13925): Terminating (SIGINT) 05:45:44.942324 run patchelf(pid=13925): Terminated: ok {rc=0} 05:45:45.076929 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13922): Process ended prematurely: osmo-stp_10.42.42.5(pid=13922) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13922)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 05:45:45.087372 tst iperf3.py:8: Test FAILED (7.9 sec) 05:45:45.115827 run osmo-hlr_10.42.42.2(pid=13919): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13919)] 05:45:45.165809 run osmo-hlr_10.42.42.2(pid=13919): stdout: | (launched: 2022-12-14_05:45:41.617523) 05:45:45.217904 run osmo-hlr_10.42.42.2(pid=13919): stderr: | 20221214054541816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054541817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054541817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054541817 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054541817 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054541817 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054541829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054541838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054541838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054541838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:45.270355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13914): Terminating (SIGTERM) 05:45:45.313231 run iperf3-srv_10.42.42.10(pid=13915): Terminating (SIGTERM) 05:45:45.355565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13918): Terminating (SIGTERM) 05:45:45.398569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13921): Terminating (SIGTERM) 05:45:45.441090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13924): Terminating (SIGTERM) 05:45:45.483323 --- ParallelTerminationStrategy: PID 13914 died... 05:45:45.503232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13914): Terminated: ok {rc=0} 05:45:45.549640 --- ParallelTerminationStrategy: PID 13915 died... 05:45:45.569206 run iperf3-srv_10.42.42.10(pid=13915): Terminated {rc=256} 05:45:45.615200 --- ParallelTerminationStrategy: PID 13918 died... 05:45:45.634789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13918): Terminated: ok {rc=0} 05:45:45.680775 --- ParallelTerminationStrategy: PID 13921 died... 05:45:45.700704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13921): Terminated: ok {rc=0} 05:45:45.746625 --- ParallelTerminationStrategy: PID 13924 died... 05:45:45.766211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13924): Terminated: ok {rc=0} 05:45:45.878203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:45:47.075610 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.089581 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:47.160768 tst iperf3m4.py: using LAC 38814 05:45:47.301687 tst iperf3m4.py: using RAC 54 05:45:47.426648 tst iperf3m4.py: using CellId 38814 05:45:47.551077 tst iperf3m4.py: using BVCI 38815 05:45:47.667801 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.679052 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.690023 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.700770 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.712368 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.724217 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.735974 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.747610 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:47.759386 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:47.879437 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:48.004189 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:48.125632 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:48.247519 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:45:48.475838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:48.814404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Launched 05:45:49.107950 run iperf3-srv_10.42.42.10(pid=13929): Launched 05:45:49.234755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:45:49.461787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:49.798962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Launched 05:45:50.090755 run iperf3-srv_10.42.42.10(pid=13931): Launched 05:45:50.217364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:45:50.444756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:50.781947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13932): Launched 05:45:51.077762 run iperf3-srv_10.42.42.10(pid=13933): Launched 05:45:51.196348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:45:51.409079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:51.726973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13934): Launched 05:45:52.007312 run iperf3-srv_10.42.42.10(pid=13937): Launched 05:45:52.133931 tst iperf3m4.py:8: start network... 05:45:52.360584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:52.881699 run create_hlr_db(pid=13940): Launched 05:45:53.017253 bus /gobi_6: Setting Powered False 05:45:54.082737 run create_hlr_db(pid=13940): Terminated: ok {rc=0} 05:45:54.532692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13942): Launched 05:45:54.848706 run osmo-hlr_10.42.42.2(pid=13943): Launched 05:45:54.969152 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:55.527428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13945): Launched 05:45:55.843476 run osmo-stp_10.42.42.5(pid=13946): Launched 05:45:55.966189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:56.510251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13948): Launched 05:45:56.631240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:56.898256 run patchelf(pid=13949): Launched 05:45:57.073117 run osmo-stp_10.42.42.5(pid=13946): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13946)] 05:45:57.206283 run osmo-stp_10.42.42.5(pid=13946): stdout: | (launched: 2022-12-14_05:45:55.785363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:57.341456 run osmo-stp_10.42.42.5(pid=13946): stderr: | 20221214054555953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054555954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054555954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054555954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054555955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054555955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054555955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:57.476529 run osmo-stp_10.42.42.5(pid=13946): stdout: | (launched: 2022-12-14_05:45:55.785363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:57.605464 run osmo-stp_10.42.42.5(pid=13946): stderr: | 20221214054555953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054555954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054555954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054555954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054555955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054555955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054555955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:57.757973 run patchelf(pid=13949): Terminating (SIGINT) 05:45:57.933736 run patchelf(pid=13949): Terminated: ok {rc=0} 05:45:58.061185 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13946): Process ended prematurely: osmo-stp_10.42.42.5(pid=13946) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13946)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:45:58.070850 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:45:58.098436 run osmo-hlr_10.42.42.2(pid=13943): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13943)] 05:45:58.147121 run osmo-hlr_10.42.42.2(pid=13943): stdout: | (launched: 2022-12-14_05:45:54.790664) 05:45:58.197197 run osmo-hlr_10.42.42.2(pid=13943): stderr: | 20221214054554967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054554967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054554967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054554967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054554967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054554967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054554981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054554989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054554989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054554989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:58.247116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Terminating (SIGTERM) 05:45:58.287660 run iperf3-srv_10.42.42.10(pid=13929): Terminating (SIGTERM) 05:45:58.328276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Terminating (SIGTERM) 05:45:58.368776 run iperf3-srv_10.42.42.10(pid=13931): Terminating (SIGTERM) 05:45:58.409574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13932): Terminating (SIGTERM) 05:45:58.450530 run iperf3-srv_10.42.42.10(pid=13933): Terminating (SIGTERM) 05:45:58.490851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13934): Terminating (SIGTERM) 05:45:58.531310 run iperf3-srv_10.42.42.10(pid=13937): Terminating (SIGTERM) 05:45:58.571687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13942): Terminating (SIGTERM) 05:45:58.612369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13945): Terminating (SIGTERM) 05:45:58.652772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13948): Terminating (SIGTERM) 05:45:58.693698 --- ParallelTerminationStrategy: PID 13928 died... 05:45:58.713349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Terminated: ok {rc=0} 05:45:58.758066 --- ParallelTerminationStrategy: PID 13929 died... 05:45:58.777149 run iperf3-srv_10.42.42.10(pid=13929): Terminated {rc=256} 05:45:58.821695 --- ParallelTerminationStrategy: PID 13930 died... 05:45:58.840767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Terminated: ok {rc=0} 05:45:58.885593 --- ParallelTerminationStrategy: PID 13931 died... 05:45:58.904555 run iperf3-srv_10.42.42.10(pid=13931): Terminated {rc=256} 05:45:58.948818 --- ParallelTerminationStrategy: PID 13932 died... 05:45:58.968314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13932): Terminated: ok {rc=0} 05:45:59.013058 --- ParallelTerminationStrategy: PID 13933 died... 05:45:59.032001 run iperf3-srv_10.42.42.10(pid=13933): Terminated {rc=256} 05:45:59.076278 --- ParallelTerminationStrategy: PID 13934 died... 05:45:59.095353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13934): Terminated: ok {rc=0} 05:45:59.139602 --- ParallelTerminationStrategy: PID 13937 died... 05:45:59.158671 run iperf3-srv_10.42.42.10(pid=13937): Terminated {rc=256} 05:45:59.202781 --- ParallelTerminationStrategy: PID 13942 died... 05:45:59.221965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13942): Terminated: ok {rc=0} 05:45:59.266472 --- ParallelTerminationStrategy: PID 13945 died... 05:45:59.285523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13945): Terminated: ok {rc=0} 05:45:59.329972 --- ParallelTerminationStrategy: PID 13948 died... 05:45:59.350879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13948): Terminated: ok {rc=0} 05:45:59.442593 bus /gobi_4: Setting Powered False 05:46:00.542335 bus /gobi_4: Setting Powered False 05:46:01.668618 bus /gobi_1: Setting Powered False 05:46:02.777908 bus /gobi_1: Setting Powered False 05:46:03.892936 bus /gobi_0: Setting Powered False 05:46:04.993403 bus /gobi_0: Setting Powered False 05:46:06.111866 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:46:07.216392 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.227931 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:46:07.285497 tst ping.py: using LAC 38815 05:46:07.413159 tst ping.py: using RAC 55 05:46:07.534365 tst ping.py: using CellId 38815 05:46:07.655584 tst ping.py: using BVCI 38816 05:46:07.768335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.779456 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.790258 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.800867 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.811830 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.823132 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.834261 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:07.845219 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:46:07.960315 tst ping.py:19: start network... 05:46:08.168845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:08.647001 run create_hlr_db(pid=13950): Launched 05:46:08.763729 bus /gobi_6: Setting Powered False 05:46:09.824818 run create_hlr_db(pid=13950): Terminated: ok {rc=0} 05:46:10.257514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13952): Launched 05:46:10.567038 run osmo-hlr_10.42.42.2(pid=13953): Launched 05:46:10.685553 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:11.236058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13955): Launched 05:46:11.545911 run osmo-stp_10.42.42.5(pid=13956): Launched 05:46:11.664459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:46:12.198940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13958): Launched 05:46:12.316873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:46:12.580516 run patchelf(pid=13959): Launched 05:46:12.752691 run osmo-stp_10.42.42.5(pid=13956): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13956)] 05:46:12.883844 run osmo-stp_10.42.42.5(pid=13956): stdout: | (launched: 2022-12-14_05:46:11.488574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:13.016779 run osmo-stp_10.42.42.5(pid=13956): stderr: | 20221214054611663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054611663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054611663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054611663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054611666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054611666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054611666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:13.149680 run osmo-stp_10.42.42.5(pid=13956): stdout: | (launched: 2022-12-14_05:46:11.488574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:13.276173 run osmo-stp_10.42.42.5(pid=13956): stderr: | 20221214054611663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054611663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054611663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054611663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054611666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054611666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054611666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:13.426303 run patchelf(pid=13959): Terminating (SIGINT) 05:46:13.598800 run patchelf(pid=13959): Terminated: ok {rc=0} 05:46:13.723341 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13956): Process ended prematurely: osmo-stp_10.42.42.5(pid=13956) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13956)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 05:46:13.732410 tst ping.py:22: Test FAILED (6.5 sec) 05:46:13.759439 run osmo-hlr_10.42.42.2(pid=13953): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13953)] 05:46:13.808108 run osmo-hlr_10.42.42.2(pid=13953): stdout: | (launched: 2022-12-14_05:46:10.509608) 05:46:13.858297 run osmo-hlr_10.42.42.2(pid=13953): stderr: | 20221214054610688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054610688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054610688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054610688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054610688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054610688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054610703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054610712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054610712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054610712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:13.908831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13952): Terminating (SIGTERM) 05:46:13.949700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13955): Terminating (SIGTERM) 05:46:13.990290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13958): Terminating (SIGTERM) 05:46:14.031184 --- ParallelTerminationStrategy: PID 13952 died... 05:46:14.050949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13952): Terminated: ok {rc=0} 05:46:14.095770 --- ParallelTerminationStrategy: PID 13955 died... 05:46:14.115033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13955): Terminated: ok {rc=0} 05:46:14.159689 --- ParallelTerminationStrategy: PID 13958 died... 05:46:14.178868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13958): Terminated: ok {rc=0} 05:46:14.263395 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:46:15.351032 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:15.363914 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:46:15.424689 tst ping_idle_ping.py: using LAC 38816 05:46:15.560058 tst ping_idle_ping.py: using RAC 56 05:46:15.686823 tst ping_idle_ping.py: using CellId 38816 05:46:15.808663 tst ping_idle_ping.py: using BVCI 38817 05:46:15.942107 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:15.953716 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:15.965147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:15.976359 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:15.987894 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:15.999426 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:16.011108 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:46:16.022580 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:46:16.150740 tst ping_idle_ping.py:24: start network... 05:46:16.406104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:16.938617 run create_hlr_db(pid=13960): Launched 05:46:17.100667 bus /gobi_6: Setting Powered False 05:46:18.166441 run create_hlr_db(pid=13960): Terminated: ok {rc=0} 05:46:18.612807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13962): Launched 05:46:18.924726 run osmo-hlr_10.42.42.2(pid=13963): Launched 05:46:19.044031 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:19.579194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13965): Launched 05:46:19.890912 run osmo-stp_10.42.42.5(pid=13966): Launched 05:46:20.012027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:46:20.550025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13968): Launched 05:46:20.669325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:46:20.932738 run patchelf(pid=13969): Launched 05:46:21.105750 run osmo-stp_10.42.42.5(pid=13966): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13966)] 05:46:21.237439 run osmo-stp_10.42.42.5(pid=13966): stdout: | (launched: 2022-12-14_05:46:19.833262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:21.371303 run osmo-stp_10.42.42.5(pid=13966): stderr: | 20221214054620004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054620005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054620005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054620005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054620007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054620008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054620008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:21.504885 run osmo-stp_10.42.42.5(pid=13966): stdout: | (launched: 2022-12-14_05:46:19.833262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:21.632032 run osmo-stp_10.42.42.5(pid=13966): stderr: | 20221214054620004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054620005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054620005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054620005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054620007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054620008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054620008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:21.782699 run patchelf(pid=13969): Terminating (SIGINT) 05:46:21.956569 run patchelf(pid=13969): Terminated: ok {rc=0} 05:46:22.082176 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13966): Process ended prematurely: osmo-stp_10.42.42.5(pid=13966) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13966)] [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:46:22.091325 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 05:46:22.118084 run osmo-hlr_10.42.42.2(pid=13963): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13963)] 05:46:22.166606 run osmo-hlr_10.42.42.2(pid=13963): stdout: | (launched: 2022-12-14_05:46:18.867252) 05:46:22.216466 run osmo-hlr_10.42.42.2(pid=13963): stderr: | 20221214054619046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054619046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054619046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054619046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054619046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054619046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054619095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054619104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054619104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054619105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:22.267064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13962): Terminating (SIGTERM) 05:46:22.307577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13965): Terminating (SIGTERM) 05:46:22.348054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13968): Terminating (SIGTERM) 05:46:22.388803 --- ParallelTerminationStrategy: PID 13962 died... 05:46:22.408517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13962): Terminated: ok {rc=0} 05:46:22.453291 --- ParallelTerminationStrategy: PID 13965 died... 05:46:22.472278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13965): Terminated: ok {rc=0} 05:46:22.517525 --- ParallelTerminationStrategy: PID 13968 died... 05:46:22.536603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13968): Terminated: ok {rc=0} 05:46:22.624158 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:46:23.913088 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:23.920229 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:46:23.940928 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:46:23.976372 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:46:24.030923 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:46:24.052499 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:46:24.086752 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:46:24.641610 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:46:24.647019 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:24.658375 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:46:24.716108 tst switch_tch_pdch.py: using LAC 38817 05:46:24.839439 tst switch_tch_pdch.py: using RAC 57 05:46:24.965090 tst switch_tch_pdch.py: using CellId 38817 05:46:25.088798 tst switch_tch_pdch.py: using BVCI 38818 05:46:25.203519 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.214996 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.225933 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.237007 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.248095 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.259558 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.271139 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:46:25.282503 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:46:25.403909 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:46:25.522496 tst switch_tch_pdch.py:51: start network... 05:46:25.731775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:26.213036 run create_hlr_db(pid=13973): Launched 05:46:26.331331 bus /gobi_6: Setting Powered False 05:46:27.393535 run create_hlr_db(pid=13973): Terminated: ok {rc=0} 05:46:27.845656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13976): Launched 05:46:28.174628 run osmo-hlr_10.42.42.2(pid=13977): Launched 05:46:28.300848 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:28.874117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13979): Launched 05:46:29.203338 run osmo-stp_10.42.42.5(pid=13980): Launched 05:46:29.330249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:46:29.899327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13982): Launched 05:46:30.026878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:46:30.305561 run patchelf(pid=13983): Launched 05:46:30.488317 run osmo-stp_10.42.42.5(pid=13980): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13980)] 05:46:30.627431 run osmo-stp_10.42.42.5(pid=13980): stdout: | (launched: 2022-12-14_05:46:29.143202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:30.768568 run osmo-stp_10.42.42.5(pid=13980): stderr: | 20221214054629336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054629336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054629336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054629337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054629337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054629337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054629337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:30.915924 run osmo-stp_10.42.42.5(pid=13980): stdout: | (launched: 2022-12-14_05:46:29.143202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:31.052418 run osmo-stp_10.42.42.5(pid=13980): stderr: | 20221214054629336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054629336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054629336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054629337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054629337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054629337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054629337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:31.214908 run patchelf(pid=13983): Terminating (SIGINT) 05:46:31.401769 run patchelf(pid=13983): Terminated: ok {rc=0} 05:46:31.536393 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13980): Process ended prematurely: osmo-stp_10.42.42.5(pid=13980) [trial-2400↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13980)] [trial-2400↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:46:31.546642 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 05:46:31.575363 run osmo-hlr_10.42.42.2(pid=13977): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13977)] 05:46:31.626828 run osmo-hlr_10.42.42.2(pid=13977): stdout: | (launched: 2022-12-14_05:46:28.114371) 05:46:31.679743 run osmo-hlr_10.42.42.2(pid=13977): stderr: | 20221214054628314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054628314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054628314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054628314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054628314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054628314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054628326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054628336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054628337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054628337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:31.733234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13976): Terminating (SIGTERM) 05:46:31.776394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13979): Terminating (SIGTERM) 05:46:31.820651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13982): Terminating (SIGTERM) 05:46:31.863674 --- ParallelTerminationStrategy: PID 13976 died... 05:46:31.884672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13976): Terminated: ok {rc=0} 05:46:31.931840 --- ParallelTerminationStrategy: PID 13979 died... 05:46:31.952097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13979): Terminated: ok {rc=0} 05:46:31.998976 --- ParallelTerminationStrategy: PID 13982 died... 05:46:32.019433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13982): Terminated: ok {rc=0} 05:46:32.112785 bus /gobi_0: Setting Powered False 05:46:33.213032 bus /gobi_0: Setting Powered False 05:46:34.327504 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:46:35.564313 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:35.571402 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:46:35.592247 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:46:35.627180 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:46:35.683775 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:46:35.705405 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:46:35.739359 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:46:36.293178 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:46:36.298575 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.309990 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:46:36.366401 tst switch_tch_pdch.py: using LAC 38818 05:46:36.492299 tst switch_tch_pdch.py: using RAC 58 05:46:36.618002 tst switch_tch_pdch.py: using CellId 38818 05:46:36.743185 tst switch_tch_pdch.py: using BVCI 38819 05:46:36.853913 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.864790 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.875636 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.886392 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.897340 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.908710 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.919858 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:36.930868 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:46:37.050193 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:46:37.165409 tst switch_tch_pdch.py:51: start network... 05:46:37.368691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:37.810136 run create_hlr_db(pid=13987): Launched 05:46:37.924526 bus /gobi_6: Setting Powered False 05:46:38.984905 run create_hlr_db(pid=13987): Terminated: ok {rc=0} 05:46:39.378489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13989): Launched 05:46:39.678846 run osmo-hlr_10.42.42.2(pid=13990): Launched 05:46:39.794064 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:40.296260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13992): Launched 05:46:40.596094 run osmo-stp_10.42.42.5(pid=13993): Launched 05:46:40.711609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:46:41.206759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13995): Launched 05:46:41.321398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:46:41.575978 run patchelf(pid=13996): Launched 05:46:41.743143 run osmo-stp_10.42.42.5(pid=13993): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13993)] 05:46:41.869983 run osmo-stp_10.42.42.5(pid=13993): stdout: | (launched: 2022-12-14_05:46:40.540904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:41.998454 run osmo-stp_10.42.42.5(pid=13993): stderr: | 20221214054640709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054640709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054640709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054640710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054640710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054640710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054640710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:42.127127 run osmo-stp_10.42.42.5(pid=13993): stdout: | (launched: 2022-12-14_05:46:40.540904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:42.249917 run osmo-stp_10.42.42.5(pid=13993): stderr: | 20221214054640709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054640709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054640709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054640710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054640710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054640710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054640710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:42.395651 run patchelf(pid=13996): Terminating (SIGINT) 05:46:42.562893 run patchelf(pid=13996): Terminated: ok {rc=0} 05:46:42.684029 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13993): Process ended prematurely: osmo-stp_10.42.42.5(pid=13993) [trial-2400↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13993)] [trial-2400↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:46:42.693001 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 05:46:42.719012 run osmo-hlr_10.42.42.2(pid=13990): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13990)] 05:46:42.767046 run osmo-hlr_10.42.42.2(pid=13990): stdout: | (launched: 2022-12-14_05:46:39.623687) 05:46:42.816233 run osmo-hlr_10.42.42.2(pid=13990): stderr: | 20221214054639796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054639796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054639796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054639796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054639796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054639796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054639808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054639817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054639817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054639817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:42.865560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13989): Terminating (SIGTERM) 05:46:42.905355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13992): Terminating (SIGTERM) 05:46:42.945235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13995): Terminating (SIGTERM) 05:46:42.984734 --- ParallelTerminationStrategy: PID 13989 died... 05:46:43.003987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13989): Terminated: ok {rc=0} 05:46:43.047567 --- ParallelTerminationStrategy: PID 13992 died... 05:46:43.066281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13992): Terminated: ok {rc=0} 05:46:43.109803 --- ParallelTerminationStrategy: PID 13995 died... 05:46:43.128579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13995): Terminated: ok {rc=0} 05:46:43.214472 bus /gobi_0: Setting Powered False 05:46:44.311421 bus /gobi_0: Setting Powered False 05:46:45.423164 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:trx-b200 --------------------------------------------------------------------- 05:46:46.687531 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:46.692405 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:46.727047 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 05:46:46.734665 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 05:46:46.789551 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:46.823995 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 05:46:46.833236 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 05:46:47.365979 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 05:46:47.371278 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 05:46:47.382178 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 05:46:47.433097 tst mo_mt_sms.py: using LAC 38819 05:46:47.551179 tst mo_mt_sms.py: using RAC 59 05:46:47.672372 tst mo_mt_sms.py: using CellId 38819 05:46:47.792518 tst mo_mt_sms.py: using BVCI 38820 05:46:47.902834 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:48.019957 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:48.134371 tst mo_mt_sms.py:9: start nitb and bts... 05:46:48.338744 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:46:48.953022 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14000): Launched 05:46:49.254144 run osmo-nitb_10.42.42.2(pid=14001): Launched 05:46:49.421092 run osmo-nitb_10.42.42.2(pid=14001): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14001)] 05:46:49.556357 run osmo-nitb_10.42.42.2(pid=14001): stdout: | (launched: 2022-12-14_05:46:49.199011) 05:46:49.693519 run osmo-nitb_10.42.42.2(pid=14001): stderr: | (launched: 2022-12-14_05:46:49.243699) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:49.830642 run osmo-nitb_10.42.42.2(pid=14001): stdout: | (launched: 2022-12-14_05:46:49.199011) 05:46:49.961810 run osmo-nitb_10.42.42.2(pid=14001): stderr: | (launched: 2022-12-14_05:46:49.243699) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14001) [trial-2400↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14001)] 05:46:50.368635 tst osmo-nitb_10.42.42.2(pid=14001): stdout: | (launched: 2022-12-14_05:46:49.199011) 05:46:50.489361 tst osmo-nitb_10.42.42.2(pid=14001): stderr: | (launched: 2022-12-14_05:46:49.243699) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:50.631713 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14001) [trial-2400↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14001)] [trial-2400↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 05:46:50.640096 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 05:46:50.646671 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14000): Terminating (SIGTERM) 05:46:50.855092 --- ParallelTerminationStrategy: PID 14000 died... 05:46:50.875812 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14000): Terminated: ok {rc=0} 05:46:50.960730 bus /sierra_3: Setting Powered False 05:46:52.060276 bus /sierra_3: Setting Powered False 05:46:53.177652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:trx-b200 --------------------------------------------------------------------- 05:46:54.384130 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:54.389550 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:54.423882 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:46:54.451207 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 05:46:54.502595 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:54.536527 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:46:54.564242 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 05:46:55.111734 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 05:46:55.117276 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:55.128278 tst sms:trx-b200: Using 1 x bts (candidates: 1) 05:46:55.177535 tst mo_mt_sms.py: using LAC 38820 05:46:55.302491 tst mo_mt_sms.py: using RAC 60 05:46:55.427837 tst mo_mt_sms.py: using CellId 38820 05:46:55.551838 tst mo_mt_sms.py: using BVCI 38821 05:46:55.668470 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:55.679441 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:55.690243 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:55.700808 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:55.711539 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:55.722972 tst sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:55.839271 tst sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:55.953293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:56.420120 run create_hlr_db(pid=14005): Launched 05:46:56.535844 bus /sierra_2: Setting Powered False 05:46:57.596390 run create_hlr_db(pid=14005): Terminated: ok {rc=0} 05:46:58.016734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14007): Launched 05:46:58.318026 run osmo-hlr_10.42.42.2(pid=14008): Launched 05:46:58.433483 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:58.963488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14010): Launched 05:46:59.263344 run osmo-stp_10.42.42.5(pid=14011): Launched 05:46:59.378881 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:59.920553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14013): Launched 05:47:00.220419 run osmo-msc_10.42.42.6(pid=14014): Launched 05:47:00.388654 run osmo-stp_10.42.42.5(pid=14011): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14011)] 05:47:00.516474 run osmo-stp_10.42.42.5(pid=14011): stdout: | (launched: 2022-12-14_05:46:59.208404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:00.643734 run osmo-stp_10.42.42.5(pid=14011): stderr: | 20221214054659376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054659377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054659377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054659377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054659378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054659378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054659378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:00.768748 run osmo-stp_10.42.42.5(pid=14011): stdout: | (launched: 2022-12-14_05:46:59.208404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:00.926834 run osmo-stp_10.42.42.5(pid=14011): stderr: | 20221214054659376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054659377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054659377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054659377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054659378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054659378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054659378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:01.083498 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14011): Process ended prematurely: osmo-stp_10.42.42.5(pid=14011) [trial-2400↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14011)] [trial-2400↪sms:trx-b200↪mo_mt_sms.py:16] 05:47:01.092799 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 05:47:01.119831 run osmo-hlr_10.42.42.2(pid=14008): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14008)] 05:47:01.170743 run osmo-hlr_10.42.42.2(pid=14008): stdout: | (launched: 2022-12-14_05:46:58.262813) 05:47:01.222024 run osmo-hlr_10.42.42.2(pid=14008): stderr: | 20221214054658436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054658436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054658436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054658436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054658436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054658436 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054658448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054658457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054658457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054658457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:01.294288 run osmo-msc_10.42.42.6(pid=14014): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14014)] 05:47:01.342796 run osmo-msc_10.42.42.6(pid=14014): stdout: | (launched: 2022-12-14_05:47:00.165293) 05:47:01.394023 run osmo-msc_10.42.42.6(pid=14014): stderr: | 20221214054700436 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054700436 DLGLOBAL DEBUG validating counter group 0x7f687b6bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054700436 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054700436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054700436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054700437 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054700438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054700439 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054700439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054700439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:01.445980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14007): Terminating (SIGTERM) 05:47:01.487673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14010): Terminating (SIGTERM) 05:47:01.529615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14013): Terminating (SIGTERM) 05:47:01.571725 --- ParallelTerminationStrategy: PID 14007 died... 05:47:01.592722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14007): Terminated: ok {rc=0} 05:47:01.639116 --- ParallelTerminationStrategy: PID 14010 died... 05:47:01.659917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14010): Terminated: ok {rc=0} 05:47:01.706477 --- ParallelTerminationStrategy: PID 14013 died... 05:47:01.727375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14013): Terminated: ok {rc=0} 05:47:01.819756 bus /sierra_3: Setting Powered False 05:47:02.929121 bus /sierra_3: Setting Powered False 05:47:04.041849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-b200 --------------------------------------------------------------------- 05:47:05.277216 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:05.282194 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 05:47:05.315909 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 05:47:05.323165 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 05:47:05.357556 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 05:47:05.391397 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 05:47:05.398423 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 05:47:05.918974 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 05:47:05.924314 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 05:47:05.935552 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 05:47:05.983684 tst assert_extension.py: using LAC 38821 05:47:06.107449 tst assert_extension.py: using RAC 61 05:47:06.230568 tst assert_extension.py: using CellId 38821 05:47:06.354361 tst assert_extension.py: using BVCI 38822 05:47:06.472243 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 05:47:06.586553 tst assert_extension.py:10: start nitb and bts... 05:47:06.787676 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:47:07.397365 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14019): Launched 05:47:07.693570 run osmo-nitb_10.42.42.2(pid=14020): Launched 05:47:07.858061 run osmo-nitb_10.42.42.2(pid=14020): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14020)] 05:47:07.991373 run osmo-nitb_10.42.42.2(pid=14020): stdout: | (launched: 2022-12-14_05:47:07.639551) 05:47:08.126350 run osmo-nitb_10.42.42.2(pid=14020): stderr: | (launched: 2022-12-14_05:47:07.683661) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:47:08.261199 run osmo-nitb_10.42.42.2(pid=14020): stdout: | (launched: 2022-12-14_05:47:07.639551) 05:47:08.390514 run osmo-nitb_10.42.42.2(pid=14020): stderr: | (launched: 2022-12-14_05:47:07.683661) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14020): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14020) [trial-2400↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14020)] 05:47:08.806106 tst osmo-nitb_10.42.42.2(pid=14020): stdout: | (launched: 2022-12-14_05:47:07.639551) 05:47:08.926221 tst osmo-nitb_10.42.42.2(pid=14020): stderr: | (launched: 2022-12-14_05:47:07.683661) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:47:09.067829 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14020): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14020) [trial-2400↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14020)] [trial-2400↪nitb_ussd:trx-b200↪assert_extension.py:12] 05:47:09.076189 tst assert_extension.py:12: Test FAILED (3.1 sec) 05:47:09.082715 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14019): Terminating (SIGTERM) 05:47:09.291451 --- ParallelTerminationStrategy: PID 14019 died... 05:47:09.312063 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14019): Terminated: ok {rc=0} 05:47:09.398322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:trx-b200 --------------------------------------------------------------------- 05:47:10.578593 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:10.584034 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 05:47:10.617506 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:47:10.644917 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 05:47:10.682987 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 05:47:10.715593 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:47:10.742081 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 05:47:11.269983 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:trx-b200 assert_extension.py ---------------------------------------------- 05:47:11.275338 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:47:11.286462 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 05:47:11.333893 tst assert_extension.py: using LAC 38822 05:47:11.458963 tst assert_extension.py: using RAC 62 05:47:11.584436 tst assert_extension.py: using CellId 38822 05:47:11.710919 tst assert_extension.py: using BVCI 38823 05:47:11.827883 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:47:11.838823 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:47:11.849628 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:47:11.860300 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:47:11.871147 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:47:11.882238 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 05:47:11.996001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:12.457925 run create_hlr_db(pid=14024): Launched 05:47:12.571846 bus /sierra_2: Setting Powered False 05:47:13.631198 run create_hlr_db(pid=14024): Terminated: ok {rc=0} 05:47:14.066426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14026): Launched 05:47:14.387761 run osmo-hlr_10.42.42.2(pid=14027): Launched 05:47:14.509364 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:15.058619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14029): Launched 05:47:15.375125 run osmo-stp_10.42.42.5(pid=14030): Launched 05:47:15.495541 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:16.094921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14032): Launched 05:47:16.434108 run osmo-msc_10.42.42.6(pid=14033): Launched 05:47:16.815545 run osmo-stp_10.42.42.5(pid=14030): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14030)] 05:47:17.076932 run osmo-stp_10.42.42.5(pid=14030): stdout: | (launched: 2022-12-14_05:47:15.317644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:17.208720 run osmo-stp_10.42.42.5(pid=14030): stderr: | 20221214054715503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054715503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054715503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054715504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054715504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054715504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054715504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:17.336493 run osmo-stp_10.42.42.5(pid=14030): stdout: | (launched: 2022-12-14_05:47:15.317644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:17.459455 run osmo-stp_10.42.42.5(pid=14030): stderr: | 20221214054715503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054715503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054715503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054715504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054715504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054715504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054715504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:17.603105 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14030): Process ended prematurely: osmo-stp_10.42.42.5(pid=14030) [trial-2400↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14030)] [trial-2400↪ussd:trx-b200↪assert_extension.py:17] 05:47:17.611673 tst assert_extension.py:17: Test FAILED (6.3 sec) 05:47:17.637805 run osmo-hlr_10.42.42.2(pid=14027): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14027)] 05:47:17.687122 run osmo-hlr_10.42.42.2(pid=14027): stdout: | (launched: 2022-12-14_05:47:14.325839) 05:47:17.737491 run osmo-hlr_10.42.42.2(pid=14027): stderr: | 20221214054714521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054714521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054714521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054714521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054714521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054714521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054714534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054714542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054714542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054714542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:17.807512 run osmo-msc_10.42.42.6(pid=14033): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14033)] 05:47:17.855445 run osmo-msc_10.42.42.6(pid=14033): stdout: | (launched: 2022-12-14_05:47:16.370886) 05:47:17.905362 run osmo-msc_10.42.42.6(pid=14033): stderr: | 20221214054716755 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054716756 DLGLOBAL DEBUG validating counter group 0x7f74dac7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054716756 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054716756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054716756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054716756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054716762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054716763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054716763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054716763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:17.955905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14026): Terminating (SIGTERM) 05:47:17.996538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14029): Terminating (SIGTERM) 05:47:18.037207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14032): Terminating (SIGTERM) 05:47:18.077936 --- ParallelTerminationStrategy: PID 14026 died... 05:47:18.097710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14026): Terminated: ok {rc=0} 05:47:18.141634 --- ParallelTerminationStrategy: PID 14029 died... 05:47:18.160592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14029): Terminated: ok {rc=0} 05:47:18.204407 --- ParallelTerminationStrategy: PID 14032 died... 05:47:18.223512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14032): Terminated: ok {rc=0} 05:47:18.308694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:47:19.518233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:19.526564 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:47:19.560431 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:47:19.588064 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:47:19.642876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:47:19.676234 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:47:19.702465 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:47:20.253625 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:47:20.306787 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:20.318515 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:47:20.389722 tst mo_mt_call.py: using LAC 38823 05:47:20.518474 tst mo_mt_call.py: using RAC 63 05:47:20.645843 tst mo_mt_call.py: using CellId 38823 05:47:20.773214 tst mo_mt_call.py: using BVCI 38824 05:47:20.890920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:20.902447 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:20.913759 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:20.925086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:20.936624 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:20.948169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:47:21.065240 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:47:21.187117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:21.691854 run create_hlr_db(pid=14038): Launched 05:47:21.824714 bus /sierra_2: Setting Powered False 05:47:22.888690 run create_hlr_db(pid=14038): Terminated: ok {rc=0} 05:47:23.324013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14040): Launched 05:47:23.628691 run osmo-hlr_10.42.42.2(pid=14041): Launched 05:47:23.744449 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:24.273558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14043): Launched 05:47:24.579728 run osmo-stp_10.42.42.5(pid=14044): Launched 05:47:24.695637 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:25.248013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14046): Launched 05:47:25.553544 run osmo-msc_10.42.42.6(pid=14047): Launched 05:47:25.724320 run osmo-stp_10.42.42.5(pid=14044): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14044)] 05:47:25.853541 run osmo-stp_10.42.42.5(pid=14044): stdout: | (launched: 2022-12-14_05:47:24.522919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:25.982584 run osmo-stp_10.42.42.5(pid=14044): stderr: | 20221214054724692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054724692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054724693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054724693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054724694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054724694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054724694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:26.109276 run osmo-stp_10.42.42.5(pid=14044): stdout: | (launched: 2022-12-14_05:47:24.522919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:26.230484 run osmo-stp_10.42.42.5(pid=14044): stderr: | 20221214054724692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054724692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054724693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054724693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054724694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054724694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054724694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:26.375485 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14044): Process ended prematurely: osmo-stp_10.42.42.5(pid=14044) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14044)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:47:26.384585 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:47:26.410428 run osmo-hlr_10.42.42.2(pid=14041): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14041)] 05:47:26.458570 run osmo-hlr_10.42.42.2(pid=14041): stdout: | (launched: 2022-12-14_05:47:23.573170) 05:47:26.507876 run osmo-hlr_10.42.42.2(pid=14041): stderr: | 20221214054723748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054723748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054723748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054723748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054723748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054723748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054723760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054723769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054723769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054723769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:26.576642 run osmo-msc_10.42.42.6(pid=14047): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14047)] 05:47:26.623954 run osmo-msc_10.42.42.6(pid=14047): stdout: | (launched: 2022-12-14_05:47:25.497694) 05:47:26.673138 run osmo-msc_10.42.42.6(pid=14047): stderr: | 20221214054725767 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054725767 DLGLOBAL DEBUG validating counter group 0x7faf4c0d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054725767 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054725767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054725768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054725768 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054725769 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054725770 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054725770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054725770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:26.722536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14040): Terminating (SIGTERM) 05:47:26.762022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14043): Terminating (SIGTERM) 05:47:26.801987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14046): Terminating (SIGTERM) 05:47:26.841626 --- ParallelTerminationStrategy: PID 14040 died... 05:47:26.861050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14040): Terminated: ok {rc=0} 05:47:26.904815 --- ParallelTerminationStrategy: PID 14043 died... 05:47:26.923547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14043): Terminated: ok {rc=0} 05:47:26.967557 --- ParallelTerminationStrategy: PID 14046 died... 05:47:26.986476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14046): Terminated: ok {rc=0} 05:47:27.072396 bus /sierra_3: Setting Powered False 05:47:28.171598 bus /sierra_3: Setting Powered False 05:47:29.287174 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:47:30.433264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:30.444886 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:47:30.513573 tst mo_mt_call_osmux.py: using LAC 38824 05:47:30.643717 tst mo_mt_call_osmux.py: using RAC 64 05:47:30.771495 tst mo_mt_call_osmux.py: using CellId 38824 05:47:30.910951 tst mo_mt_call_osmux.py: using BVCI 38825 05:47:31.036565 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:31.048861 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:31.060747 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:31.072625 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:31.086011 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:31.099279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:47:31.244041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:47:31.362738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:31.863005 run create_hlr_db(pid=14049): Launched 05:47:32.022696 bus /sierra_2: Setting Powered False 05:47:33.083484 run create_hlr_db(pid=14049): Terminated: ok {rc=0} 05:47:33.531217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14051): Launched 05:47:33.842515 run osmo-hlr_10.42.42.2(pid=14052): Launched 05:47:33.958330 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:34.498658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14054): Launched 05:47:34.804923 run osmo-stp_10.42.42.5(pid=14055): Launched 05:47:34.921748 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:35.473745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14057): Launched 05:47:35.779531 run osmo-msc_10.42.42.6(pid=14058): Launched 05:47:35.949564 run osmo-stp_10.42.42.5(pid=14055): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14055)] 05:47:36.079023 run osmo-stp_10.42.42.5(pid=14055): stdout: | (launched: 2022-12-14_05:47:34.748687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:36.207917 run osmo-stp_10.42.42.5(pid=14055): stderr: | 20221214054734917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054734917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054734918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054734918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054734919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054734919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054734919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:36.335111 run osmo-stp_10.42.42.5(pid=14055): stdout: | (launched: 2022-12-14_05:47:34.748687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:36.456288 run osmo-stp_10.42.42.5(pid=14055): stderr: | 20221214054734917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054734917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054734918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054734918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054734919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054734919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054734919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:36.601518 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14055): Process ended prematurely: osmo-stp_10.42.42.5(pid=14055) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14055)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:47:36.610607 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:47:36.636807 run osmo-hlr_10.42.42.2(pid=14052): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14052)] 05:47:36.685134 run osmo-hlr_10.42.42.2(pid=14052): stdout: | (launched: 2022-12-14_05:47:33.786577) 05:47:36.734672 run osmo-hlr_10.42.42.2(pid=14052): stderr: | 20221214054733959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054733959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054733959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054733959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054733959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054733959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054733971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054733980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054733981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054733981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:36.804101 run osmo-msc_10.42.42.6(pid=14058): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14058)] 05:47:36.851591 run osmo-msc_10.42.42.6(pid=14058): stdout: | (launched: 2022-12-14_05:47:35.722793) 05:47:36.901066 run osmo-msc_10.42.42.6(pid=14058): stderr: | 20221214054735992 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054735992 DLGLOBAL DEBUG validating counter group 0x7f25c3b0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054735992 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054735992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054735992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054735992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054735994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054735994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054735995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054735995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:36.950660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14051): Terminating (SIGTERM) 05:47:36.990652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14054): Terminating (SIGTERM) 05:47:37.030627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14057): Terminating (SIGTERM) 05:47:37.070762 --- ParallelTerminationStrategy: PID 14051 died... 05:47:37.090304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14051): Terminated: ok {rc=0} 05:47:37.134596 --- ParallelTerminationStrategy: PID 14054 died... 05:47:37.153614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14054): Terminated: ok {rc=0} 05:47:37.197643 --- ParallelTerminationStrategy: PID 14057 died... 05:47:37.216912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14057): Terminated: ok {rc=0} 05:47:37.302993 bus /sierra_3: Setting Powered False 05:47:38.401207 bus /sierra_3: Setting Powered False 05:47:39.515676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:47:40.761255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:40.767822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:47:40.800115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:47:40.826893 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:47:40.877829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:47:40.910168 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:47:40.936754 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:47:41.486898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:47:41.536733 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:41.547853 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:47:41.616178 tst mo_mt_call.py: using LAC 38825 05:47:41.735355 tst mo_mt_call.py: using RAC 65 05:47:41.857467 tst mo_mt_call.py: using CellId 38825 05:47:41.985800 tst mo_mt_call.py: using BVCI 38826 05:47:42.105386 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:42.117134 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:42.128664 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:42.140174 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:42.151622 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:42.163025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:42.281498 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:42.396633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:42.870060 run create_hlr_db(pid=14064): Launched 05:47:42.987043 bus /sierra_2: Setting Powered False 05:47:44.046969 run create_hlr_db(pid=14064): Terminated: ok {rc=0} 05:47:44.490653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14066): Launched 05:47:44.814460 run osmo-hlr_10.42.42.2(pid=14067): Launched 05:47:44.938275 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:45.501695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14069): Launched 05:47:45.825404 run osmo-stp_10.42.42.5(pid=14070): Launched 05:47:46.104306 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:46.735937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14072): Launched 05:47:47.072709 run osmo-msc_10.42.42.6(pid=14073): Launched 05:47:47.397234 run osmo-stp_10.42.42.5(pid=14070): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14070)] 05:47:47.533650 run osmo-stp_10.42.42.5(pid=14070): stdout: | (launched: 2022-12-14_05:47:45.766276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:47.669885 run osmo-stp_10.42.42.5(pid=14070): stderr: | 20221214054746000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054746000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054746001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054746001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054746001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054746002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054746002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:47.804723 run osmo-stp_10.42.42.5(pid=14070): stdout: | (launched: 2022-12-14_05:47:45.766276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:47.933707 run osmo-stp_10.42.42.5(pid=14070): stderr: | 20221214054746000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054746000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054746001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054746001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054746001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054746002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054746002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:48.087916 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14070): Process ended prematurely: osmo-stp_10.42.42.5(pid=14070) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14070)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:47:48.097699 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 05:47:48.125191 run osmo-hlr_10.42.42.2(pid=14067): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14067)] 05:47:48.174765 run osmo-hlr_10.42.42.2(pid=14067): stdout: | (launched: 2022-12-14_05:47:44.755495) 05:47:48.225945 run osmo-hlr_10.42.42.2(pid=14067): stderr: | 20221214054744950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054744950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054744950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054744950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054744950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054744950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054744962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054744970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054744971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054744971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:48.297234 run osmo-msc_10.42.42.6(pid=14073): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14073)] 05:47:48.346730 run osmo-msc_10.42.42.6(pid=14073): stdout: | (launched: 2022-12-14_05:47:47.002020) 05:47:48.398216 run osmo-msc_10.42.42.6(pid=14073): stderr: | 20221214054747375 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054747375 DLGLOBAL DEBUG validating counter group 0x7f4263f5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054747375 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054747375 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054747375 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054747375 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054747377 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054747378 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054747378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054747378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:48.449734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14066): Terminating (SIGTERM) 05:47:48.491201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14069): Terminating (SIGTERM) 05:47:48.532835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14072): Terminating (SIGTERM) 05:47:48.574947 --- ParallelTerminationStrategy: PID 14066 died... 05:47:48.594894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14066): Terminated: ok {rc=0} 05:47:48.640627 --- ParallelTerminationStrategy: PID 14069 died... 05:47:48.660277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14069): Terminated: ok {rc=0} 05:47:48.706215 --- ParallelTerminationStrategy: PID 14072 died... 05:47:48.725637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14072): Terminated: ok {rc=0} 05:47:48.813739 bus /sierra_3: Setting Powered False 05:47:49.911736 bus /sierra_3: Setting Powered False 05:47:51.029117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:47:52.174882 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:52.186724 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:47:52.259299 tst mo_mt_call_osmux.py: using LAC 38826 05:47:52.378674 tst mo_mt_call_osmux.py: using RAC 66 05:47:52.502381 tst mo_mt_call_osmux.py: using CellId 38826 05:47:52.622251 tst mo_mt_call_osmux.py: using BVCI 38827 05:47:52.734537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:52.745651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:52.756467 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:52.767377 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:52.778678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:52.789824 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:52.905795 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:53.026193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:53.531937 run create_hlr_db(pid=14075): Launched 05:47:53.663948 bus /sierra_2: Setting Powered False 05:47:54.727505 run create_hlr_db(pid=14075): Terminated: ok {rc=0} 05:47:55.164301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14077): Launched 05:47:55.471868 run osmo-hlr_10.42.42.2(pid=14078): Launched 05:47:55.589523 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:56.155897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14080): Launched 05:47:56.480808 run osmo-stp_10.42.42.5(pid=14081): Launched 05:47:56.603784 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:57.198057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14083): Launched 05:47:57.526800 run osmo-msc_10.42.42.6(pid=14084): Launched 05:47:57.709643 run osmo-stp_10.42.42.5(pid=14081): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14081)] 05:47:57.846909 run osmo-stp_10.42.42.5(pid=14081): stdout: | (launched: 2022-12-14_05:47:56.421698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:57.984287 run osmo-stp_10.42.42.5(pid=14081): stderr: | 20221214054756613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054756613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054756613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054756613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054756614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054756614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054756614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:58.120856 run osmo-stp_10.42.42.5(pid=14081): stdout: | (launched: 2022-12-14_05:47:56.421698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:58.251036 run osmo-stp_10.42.42.5(pid=14081): stderr: | 20221214054756613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054756613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054756613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054756613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054756614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054756614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054756614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:58.406933 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14081): Process ended prematurely: osmo-stp_10.42.42.5(pid=14081) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14081)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:47:58.416892 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:47:58.444757 run osmo-hlr_10.42.42.2(pid=14078): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14078)] 05:47:58.495335 run osmo-hlr_10.42.42.2(pid=14078): stdout: | (launched: 2022-12-14_05:47:55.416054) 05:47:58.547491 run osmo-hlr_10.42.42.2(pid=14078): stderr: | 20221214054755591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054755591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054755591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054755591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054755591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054755591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054755603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054755611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054755612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054755612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:58.620278 run osmo-msc_10.42.42.6(pid=14084): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14084)] 05:47:58.670372 run osmo-msc_10.42.42.6(pid=14084): stdout: | (launched: 2022-12-14_05:47:57.466928) 05:47:58.722254 run osmo-msc_10.42.42.6(pid=14084): stderr: | 20221214054757791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054757791 DLGLOBAL DEBUG validating counter group 0x7fcdcd76fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054757791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054757791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054757792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054757792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054757794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054757794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054757794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054757794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:58.774415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14077): Terminating (SIGTERM) 05:47:58.816481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14080): Terminating (SIGTERM) 05:47:58.858294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14083): Terminating (SIGTERM) 05:47:58.900379 --- ParallelTerminationStrategy: PID 14077 died... 05:47:58.920281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14077): Terminated: ok {rc=0} 05:47:58.966531 --- ParallelTerminationStrategy: PID 14080 died... 05:47:58.986215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14080): Terminated: ok {rc=0} 05:47:59.032125 --- ParallelTerminationStrategy: PID 14083 died... 05:47:59.051818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14083): Terminated: ok {rc=0} 05:47:59.138654 bus /sierra_3: Setting Powered False 05:48:00.236466 bus /sierra_3: Setting Powered False 05:48:01.351171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:48:02.624236 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:02.631561 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:48:02.665404 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:48:02.693291 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:48:02.744035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:48:02.776932 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:48:02.804036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:48:03.359233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:48:03.413590 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:03.425708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:48:03.496623 tst mo_mt_call.py: using LAC 38827 05:48:03.623683 tst mo_mt_call.py: using RAC 67 05:48:03.746099 tst mo_mt_call.py: using CellId 38827 05:48:03.868223 tst mo_mt_call.py: using BVCI 38828 05:48:03.981711 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:03.992797 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:04.003801 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:04.014827 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:04.026735 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:04.038699 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:48:04.160435 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:48:04.278037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:04.755083 run create_hlr_db(pid=14089): Launched 05:48:04.872226 bus /sierra_2: Setting Powered False 05:48:05.931993 run create_hlr_db(pid=14089): Terminated: ok {rc=0} 05:48:06.377838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14091): Launched 05:48:06.704138 run osmo-hlr_10.42.42.2(pid=14092): Launched 05:48:06.827859 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:07.392294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14094): Launched 05:48:07.717815 run osmo-stp_10.42.42.5(pid=14095): Launched 05:48:07.841225 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:08.434391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14097): Launched 05:48:08.759620 run osmo-msc_10.42.42.6(pid=14098): Launched 05:48:08.940324 run osmo-stp_10.42.42.5(pid=14095): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14095)] 05:48:09.076839 run osmo-stp_10.42.42.5(pid=14095): stdout: | (launched: 2022-12-14_05:48:07.658778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:09.214307 run osmo-stp_10.42.42.5(pid=14095): stderr: | 20221214054807850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054807850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054807851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054807851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054807853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054807853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054807853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:09.349899 run osmo-stp_10.42.42.5(pid=14095): stdout: | (launched: 2022-12-14_05:48:07.658778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:09.480451 run osmo-stp_10.42.42.5(pid=14095): stderr: | 20221214054807850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054807850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054807851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054807851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054807853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054807853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054807853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:09.635549 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14095): Process ended prematurely: osmo-stp_10.42.42.5(pid=14095) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14095)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:48:09.645221 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:48:09.672591 run osmo-hlr_10.42.42.2(pid=14092): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14092)] 05:48:09.722052 run osmo-hlr_10.42.42.2(pid=14092): stdout: | (launched: 2022-12-14_05:48:06.645193) 05:48:09.773235 run osmo-hlr_10.42.42.2(pid=14092): stderr: | 20221214054806841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054806841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054806841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054806841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054806841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054806841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054806854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054806862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054806862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054806862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:09.844304 run osmo-msc_10.42.42.6(pid=14098): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14098)] 05:48:09.893727 run osmo-msc_10.42.42.6(pid=14098): stdout: | (launched: 2022-12-14_05:48:08.700699) 05:48:09.945167 run osmo-msc_10.42.42.6(pid=14098): stderr: | 20221214054809021 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054809021 DLGLOBAL DEBUG validating counter group 0x7f640b498c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054809021 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054809021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054809021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054809022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054809023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054809024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054809024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054809024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:09.996584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14091): Terminating (SIGTERM) 05:48:10.038154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14094): Terminating (SIGTERM) 05:48:10.079556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14097): Terminating (SIGTERM) 05:48:10.121176 --- ParallelTerminationStrategy: PID 14091 died... 05:48:10.141080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14091): Terminated: ok {rc=0} 05:48:10.186878 --- ParallelTerminationStrategy: PID 14094 died... 05:48:10.206393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14094): Terminated: ok {rc=0} 05:48:10.252389 --- ParallelTerminationStrategy: PID 14097 died... 05:48:10.272058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14097): Terminated: ok {rc=0} 05:48:10.359543 bus /sierra_3: Setting Powered False 05:48:11.458255 bus /sierra_3: Setting Powered False 05:48:12.575410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:48:13.725500 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:13.737655 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:48:13.808208 tst mo_mt_call_osmux.py: using LAC 38828 05:48:13.935439 tst mo_mt_call_osmux.py: using RAC 68 05:48:14.063155 tst mo_mt_call_osmux.py: using CellId 38828 05:48:14.192727 tst mo_mt_call_osmux.py: using BVCI 38829 05:48:14.310392 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:14.322084 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:14.333568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:14.344854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:14.356356 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:48:14.367637 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:48:14.487633 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:48:14.605779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:15.079386 run create_hlr_db(pid=14100): Launched 05:48:15.196257 bus /sierra_2: Setting Powered False 05:48:16.255744 run create_hlr_db(pid=14100): Terminated: ok {rc=0} 05:48:16.697869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14102): Launched 05:48:17.058070 run osmo-hlr_10.42.42.2(pid=14103): Launched 05:48:17.225162 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:17.802604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14105): Launched 05:48:18.128629 run osmo-stp_10.42.42.5(pid=14106): Launched 05:48:18.251357 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:18.840701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14108): Launched 05:48:19.166126 run osmo-msc_10.42.42.6(pid=14109): Launched 05:48:19.347048 run osmo-stp_10.42.42.5(pid=14106): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14106)] 05:48:19.484406 run osmo-stp_10.42.42.5(pid=14106): stdout: | (launched: 2022-12-14_05:48:18.069217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:19.621831 run osmo-stp_10.42.42.5(pid=14106): stderr: | 20221214054818258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054818258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054818259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054818259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054818259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054818260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054818260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:19.757537 run osmo-stp_10.42.42.5(pid=14106): stdout: | (launched: 2022-12-14_05:48:18.069217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:19.886812 run osmo-stp_10.42.42.5(pid=14106): stderr: | 20221214054818258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054818258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054818259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054818259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054818259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054818260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054818260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:20.042035 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14106): Process ended prematurely: osmo-stp_10.42.42.5(pid=14106) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14106)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:48:20.051623 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:48:20.079274 run osmo-hlr_10.42.42.2(pid=14103): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14103)] 05:48:20.129373 run osmo-hlr_10.42.42.2(pid=14103): stdout: | (launched: 2022-12-14_05:48:16.996849) 05:48:20.180858 run osmo-hlr_10.42.42.2(pid=14103): stderr: | 20221214054817348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054817348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054817348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054817348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054817348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054817348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054817362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054817372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054817372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054817372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:20.252403 run osmo-msc_10.42.42.6(pid=14109): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14109)] 05:48:20.302017 run osmo-msc_10.42.42.6(pid=14109): stdout: | (launched: 2022-12-14_05:48:19.106895) 05:48:20.353557 run osmo-msc_10.42.42.6(pid=14109): stderr: | 20221214054819427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054819427 DLGLOBAL DEBUG validating counter group 0x7f424f9afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054819427 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054819427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054819427 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054819428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054819429 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054819430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054819430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054819430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:20.405534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14102): Terminating (SIGTERM) 05:48:20.447253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14105): Terminating (SIGTERM) 05:48:20.489022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14108): Terminating (SIGTERM) 05:48:20.530783 --- ParallelTerminationStrategy: PID 14102 died... 05:48:20.550788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14102): Terminated: ok {rc=0} 05:48:20.596579 --- ParallelTerminationStrategy: PID 14105 died... 05:48:20.616049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14105): Terminated: ok {rc=0} 05:48:20.661830 --- ParallelTerminationStrategy: PID 14108 died... 05:48:20.681450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14108): Terminated: ok {rc=0} 05:48:20.768302 bus /sierra_3: Setting Powered False 05:48:21.866342 bus /sierra_3: Setting Powered False 05:48:22.981426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:48:24.229595 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:24.236753 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:48:24.270459 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:48:24.297872 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:48:24.349218 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:48:24.383654 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:48:24.411617 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:48:24.965028 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:48:25.018217 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:25.029917 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:48:25.100392 tst mo_mt_call.py: using LAC 38829 05:48:25.227771 tst mo_mt_call.py: using RAC 69 05:48:25.352675 tst mo_mt_call.py: using CellId 38829 05:48:25.478690 tst mo_mt_call.py: using BVCI 38830 05:48:25.596216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:25.607792 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:25.619116 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:25.630378 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:25.641816 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:25.652924 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:48:25.768162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:48:25.886561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:26.392161 run create_hlr_db(pid=14114): Launched 05:48:26.525175 bus /sierra_2: Setting Powered False 05:48:27.589540 run create_hlr_db(pid=14114): Terminated: ok {rc=0} 05:48:28.025653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14116): Launched 05:48:28.332675 run osmo-hlr_10.42.42.2(pid=14117): Launched 05:48:28.449277 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:28.983012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14119): Launched 05:48:29.288217 run osmo-stp_10.42.42.5(pid=14120): Launched 05:48:29.404533 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:29.961067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14122): Launched 05:48:30.267631 run osmo-msc_10.42.42.6(pid=14123): Launched 05:48:30.438194 run osmo-stp_10.42.42.5(pid=14120): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14120)] 05:48:30.567358 run osmo-stp_10.42.42.5(pid=14120): stdout: | (launched: 2022-12-14_05:48:29.231989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:30.695965 run osmo-stp_10.42.42.5(pid=14120): stderr: | 20221214054829400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054829401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054829401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054829401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054829402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054829402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054829402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:30.822874 run osmo-stp_10.42.42.5(pid=14120): stdout: | (launched: 2022-12-14_05:48:29.231989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:30.971687 run osmo-stp_10.42.42.5(pid=14120): stderr: | 20221214054829400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054829401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054829401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054829401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054829402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054829402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054829402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:31.158070 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14120): Process ended prematurely: osmo-stp_10.42.42.5(pid=14120) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14120)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:48:31.171352 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:48:31.205042 run osmo-hlr_10.42.42.2(pid=14117): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14117)] 05:48:31.263137 run osmo-hlr_10.42.42.2(pid=14117): stdout: | (launched: 2022-12-14_05:48:28.276271) 05:48:31.320412 run osmo-hlr_10.42.42.2(pid=14117): stderr: | 20221214054828451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054828451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054828451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054828451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054828451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054828451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054828463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054828474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054828474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054828474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:31.395216 run osmo-msc_10.42.42.6(pid=14123): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14123)] 05:48:31.446130 run osmo-msc_10.42.42.6(pid=14123): stdout: | (launched: 2022-12-14_05:48:30.211679) 05:48:31.499186 run osmo-msc_10.42.42.6(pid=14123): stderr: | 20221214054830480 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054830481 DLGLOBAL DEBUG validating counter group 0x7f05fd6a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054830481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054830481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054830481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054830481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054830483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054830483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054830483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054830484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:31.553252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14116): Terminating (SIGTERM) 05:48:31.598105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14119): Terminating (SIGTERM) 05:48:31.644178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14122): Terminating (SIGTERM) 05:48:31.690894 --- ParallelTerminationStrategy: PID 14116 died... 05:48:31.711820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14116): Terminated: ok {rc=0} 05:48:31.761670 --- ParallelTerminationStrategy: PID 14119 died... 05:48:31.783634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14119): Terminated: ok {rc=0} 05:48:31.831643 --- ParallelTerminationStrategy: PID 14122 died... 05:48:31.852735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14122): Terminated: ok {rc=0} 05:48:31.964791 bus /sierra_3: Setting Powered False 05:48:33.074192 bus /sierra_3: Setting Powered False 05:48:34.189395 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:48:35.337911 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:35.349983 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:48:35.422012 tst mo_mt_call_osmux.py: using LAC 38830 05:48:35.550493 tst mo_mt_call_osmux.py: using RAC 70 05:48:35.680907 tst mo_mt_call_osmux.py: using CellId 38830 05:48:35.807933 tst mo_mt_call_osmux.py: using BVCI 38831 05:48:35.921571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:35.932674 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:35.943501 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:35.954285 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:35.965452 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:35.977081 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:48:36.093733 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:48:36.214861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:36.720064 run create_hlr_db(pid=14125): Launched 05:48:36.851596 bus /sierra_2: Setting Powered False 05:48:37.916220 run create_hlr_db(pid=14125): Terminated: ok {rc=0} 05:48:38.350936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14127): Launched 05:48:38.656664 run osmo-hlr_10.42.42.2(pid=14128): Launched 05:48:38.772303 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:39.300541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14130): Launched 05:48:39.605709 run osmo-stp_10.42.42.5(pid=14131): Launched 05:48:39.722665 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:40.274003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14133): Launched 05:48:40.580896 run osmo-msc_10.42.42.6(pid=14134): Launched 05:48:40.751366 run osmo-stp_10.42.42.5(pid=14131): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14131)] 05:48:40.881096 run osmo-stp_10.42.42.5(pid=14131): stdout: | (launched: 2022-12-14_05:48:39.550124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:41.009692 run osmo-stp_10.42.42.5(pid=14131): stderr: | 20221214054839717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054839717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054839717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054839718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054839718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054839718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054839718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:41.136233 run osmo-stp_10.42.42.5(pid=14131): stdout: | (launched: 2022-12-14_05:48:39.550124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:41.257412 run osmo-stp_10.42.42.5(pid=14131): stderr: | 20221214054839717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054839717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054839717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054839718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054839718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054839718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054839718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:41.402284 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14131): Process ended prematurely: osmo-stp_10.42.42.5(pid=14131) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14131)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:48:41.411195 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:48:41.437360 run osmo-hlr_10.42.42.2(pid=14128): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14128)] 05:48:41.484929 run osmo-hlr_10.42.42.2(pid=14128): stdout: | (launched: 2022-12-14_05:48:38.601077) 05:48:41.533943 run osmo-hlr_10.42.42.2(pid=14128): stderr: | 20221214054838776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054838776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054838776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054838776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054838776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054838776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054838789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054838798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054838798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054838798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:41.602849 run osmo-msc_10.42.42.6(pid=14134): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14134)] 05:48:41.649839 run osmo-msc_10.42.42.6(pid=14134): stdout: | (launched: 2022-12-14_05:48:40.524139) 05:48:41.698523 run osmo-msc_10.42.42.6(pid=14134): stderr: | 20221214054840794 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054840794 DLGLOBAL DEBUG validating counter group 0x7f8a61f5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054840795 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054840795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054840795 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054840795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054840797 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054840797 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054840797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054840797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:41.747805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14127): Terminating (SIGTERM) 05:48:41.787225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14130): Terminating (SIGTERM) 05:48:41.826714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14133): Terminating (SIGTERM) 05:48:41.866492 --- ParallelTerminationStrategy: PID 14127 died... 05:48:41.886048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14127): Terminated: ok {rc=0} 05:48:41.929946 --- ParallelTerminationStrategy: PID 14130 died... 05:48:41.948608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14130): Terminated: ok {rc=0} 05:48:41.992198 --- ParallelTerminationStrategy: PID 14133 died... 05:48:42.010866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14133): Terminated: ok {rc=0} 05:48:42.096026 bus /sierra_3: Setting Powered False 05:48:43.194732 bus /sierra_3: Setting Powered False 05:48:44.306356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:48:45.558615 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:45.565748 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:48:45.599599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:48:45.627052 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:48:45.680611 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:48:45.714215 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:48:45.741768 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:48:46.291775 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:48:46.344108 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:46.356237 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:48:46.429411 tst mo_mt_call.py: using LAC 38831 05:48:46.554022 tst mo_mt_call.py: using RAC 71 05:48:46.690407 tst mo_mt_call.py: using CellId 38831 05:48:46.857216 tst mo_mt_call.py: using BVCI 38832 05:48:46.986881 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:46.999133 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:47.011066 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:47.023084 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:47.036375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:47.049608 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:47.169955 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:47.290313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:47.796271 run create_hlr_db(pid=14139): Launched 05:48:47.928108 bus /sierra_2: Setting Powered False 05:48:48.992595 run create_hlr_db(pid=14139): Terminated: ok {rc=0} 05:48:49.428685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14141): Launched 05:48:49.734349 run osmo-hlr_10.42.42.2(pid=14142): Launched 05:48:49.850595 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:50.389959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14144): Launched 05:48:50.695009 run osmo-stp_10.42.42.5(pid=14145): Launched 05:48:50.810685 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:51.360428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14147): Launched 05:48:51.665370 run osmo-msc_10.42.42.6(pid=14148): Launched 05:48:51.837582 run osmo-stp_10.42.42.5(pid=14145): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14145)] 05:48:51.967122 run osmo-stp_10.42.42.5(pid=14145): stdout: | (launched: 2022-12-14_05:48:50.638970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:52.095687 run osmo-stp_10.42.42.5(pid=14145): stderr: | 20221214054850808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054850809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054850809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054850809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054850810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054850810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054850810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:52.222377 run osmo-stp_10.42.42.5(pid=14145): stdout: | (launched: 2022-12-14_05:48:50.638970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:52.342932 run osmo-stp_10.42.42.5(pid=14145): stderr: | 20221214054850808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054850809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054850809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054850809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054850810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054850810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054850810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:52.487759 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14145): Process ended prematurely: osmo-stp_10.42.42.5(pid=14145) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14145)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:48:52.496727 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:48:52.522669 run osmo-hlr_10.42.42.2(pid=14142): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14142)] 05:48:52.570385 run osmo-hlr_10.42.42.2(pid=14142): stdout: | (launched: 2022-12-14_05:48:49.678596) 05:48:52.619130 run osmo-hlr_10.42.42.2(pid=14142): stderr: | 20221214054849851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054849851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054849851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054849851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054849851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054849851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054849862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054849870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054849871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054849871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:52.687599 run osmo-msc_10.42.42.6(pid=14148): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14148)] 05:48:52.734315 run osmo-msc_10.42.42.6(pid=14148): stdout: | (launched: 2022-12-14_05:48:51.609621) 05:48:52.783121 run osmo-msc_10.42.42.6(pid=14148): stderr: | 20221214054851877 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054851877 DLGLOBAL DEBUG validating counter group 0x7fedebf51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054851877 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054851877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054851878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054851878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054851879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054851880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054851880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054851880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:52.832793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14141): Terminating (SIGTERM) 05:48:52.872139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14144): Terminating (SIGTERM) 05:48:52.911408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14147): Terminating (SIGTERM) 05:48:52.950853 --- ParallelTerminationStrategy: PID 14141 died... 05:48:52.970072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14141): Terminated: ok {rc=0} 05:48:53.013568 --- ParallelTerminationStrategy: PID 14144 died... 05:48:53.032057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14144): Terminated: ok {rc=0} 05:48:53.075770 --- ParallelTerminationStrategy: PID 14147 died... 05:48:53.094543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14147): Terminated: ok {rc=0} 05:48:53.178262 bus /sierra_3: Setting Powered False 05:48:54.273119 bus /sierra_3: Setting Powered False 05:48:55.384621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:48:56.533716 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:56.545881 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:48:56.618659 tst mo_mt_call_osmux.py: using LAC 38832 05:48:56.747711 tst mo_mt_call_osmux.py: using RAC 72 05:48:56.876511 tst mo_mt_call_osmux.py: using CellId 38832 05:48:56.997839 tst mo_mt_call_osmux.py: using BVCI 38833 05:48:57.110277 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:57.121498 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:57.132464 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:57.143506 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:57.154972 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:57.166071 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:57.287161 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:57.404575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:57.883469 run create_hlr_db(pid=14150): Launched 05:48:58.000203 bus /sierra_2: Setting Powered False 05:48:59.061221 run create_hlr_db(pid=14150): Terminated: ok {rc=0} 05:48:59.487931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14152): Launched 05:48:59.793963 run osmo-hlr_10.42.42.2(pid=14153): Launched 05:48:59.910461 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:00.440926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14155): Launched 05:49:00.747528 run osmo-stp_10.42.42.5(pid=14156): Launched 05:49:00.880260 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:01.584386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14158): Launched 05:49:01.930390 run osmo-msc_10.42.42.6(pid=14159): Launched 05:49:02.344032 run osmo-stp_10.42.42.5(pid=14156): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14156)] 05:49:02.481060 run osmo-stp_10.42.42.5(pid=14156): stdout: | (launched: 2022-12-14_05:49:00.690696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:02.616836 run osmo-stp_10.42.42.5(pid=14156): stderr: | 20221214054900918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054900919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054900919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054900919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054900920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054900920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054900920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:02.752339 run osmo-stp_10.42.42.5(pid=14156): stdout: | (launched: 2022-12-14_05:49:00.690696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:02.881730 run osmo-stp_10.42.42.5(pid=14156): stderr: | 20221214054900918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054900919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054900919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054900919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054900920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054900920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054900920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:03.036523 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14156): Process ended prematurely: osmo-stp_10.42.42.5(pid=14156) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14156)] [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:49:03.046278 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:49:03.073852 run osmo-hlr_10.42.42.2(pid=14153): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14153)] 05:49:03.123718 run osmo-hlr_10.42.42.2(pid=14153): stdout: | (launched: 2022-12-14_05:48:59.738366) 05:49:03.175176 run osmo-hlr_10.42.42.2(pid=14153): stderr: | 20221214054859910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054859910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054859910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054859910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054859910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054859911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054859922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054859930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054859931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054859931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:03.247051 run osmo-msc_10.42.42.6(pid=14159): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14159)] 05:49:03.296644 run osmo-msc_10.42.42.6(pid=14159): stdout: | (launched: 2022-12-14_05:49:01.866328) 05:49:03.348219 run osmo-msc_10.42.42.6(pid=14159): stderr: | 20221214054902194 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054902194 DLGLOBAL DEBUG validating counter group 0x7fd4dca0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054902194 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054902194 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054902194 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054902195 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054902196 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054902197 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054902197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054902197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:03.400161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14152): Terminating (SIGTERM) 05:49:03.442186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14155): Terminating (SIGTERM) 05:49:03.484107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14158): Terminating (SIGTERM) 05:49:03.526057 --- ParallelTerminationStrategy: PID 14152 died... 05:49:03.545938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14152): Terminated: ok {rc=0} 05:49:03.591752 --- ParallelTerminationStrategy: PID 14155 died... 05:49:03.611099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14155): Terminated: ok {rc=0} 05:49:03.656605 --- ParallelTerminationStrategy: PID 14158 died... 05:49:03.676065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14158): Terminated: ok {rc=0} 05:49:03.763715 bus /sierra_3: Setting Powered False 05:49:04.861103 bus /sierra_3: Setting Powered False 05:49:05.976754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:49:07.229375 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:07.236340 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:49:07.270337 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:49:07.297427 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:49:07.348932 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:49:07.383109 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:49:07.410587 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:49:07.963740 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:49:08.013822 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:08.025053 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:49:08.095431 tst mo_mt_call.py: using LAC 38833 05:49:08.214342 tst mo_mt_call.py: using RAC 73 05:49:08.335524 tst mo_mt_call.py: using CellId 38833 05:49:08.454106 tst mo_mt_call.py: using BVCI 38834 05:49:08.567185 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:08.578257 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:08.589623 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:08.600312 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:08.611514 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:08.622692 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:49:08.742762 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:49:08.863878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:09.370409 run create_hlr_db(pid=14165): Launched 05:49:09.503533 bus /sierra_2: Setting Powered False 05:49:10.567814 run create_hlr_db(pid=14165): Terminated: ok {rc=0} 05:49:11.004026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14167): Launched 05:49:11.330472 run osmo-hlr_10.42.42.2(pid=14168): Launched 05:49:11.453400 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:12.020772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14170): Launched 05:49:12.346304 run osmo-stp_10.42.42.5(pid=14171): Launched 05:49:12.469362 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:13.056462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14173): Launched 05:49:13.383306 run osmo-msc_10.42.42.6(pid=14174): Launched 05:49:13.563754 run osmo-stp_10.42.42.5(pid=14171): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14171)] 05:49:13.700393 run osmo-stp_10.42.42.5(pid=14171): stdout: | (launched: 2022-12-14_05:49:12.286779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:13.836915 run osmo-stp_10.42.42.5(pid=14171): stderr: | 20221214054912478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054912478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054912478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054912479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054912479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054912479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054912479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:13.972738 run osmo-stp_10.42.42.5(pid=14171): stdout: | (launched: 2022-12-14_05:49:12.286779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:14.102393 run osmo-stp_10.42.42.5(pid=14171): stderr: | 20221214054912478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054912478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054912478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054912479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054912479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054912479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054912479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:14.256858 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14171): Process ended prematurely: osmo-stp_10.42.42.5(pid=14171) [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14171)] [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:49:14.266388 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:49:14.293569 run osmo-hlr_10.42.42.2(pid=14168): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14168)] 05:49:14.343016 run osmo-hlr_10.42.42.2(pid=14168): stdout: | (launched: 2022-12-14_05:49:11.271349) 05:49:14.394245 run osmo-hlr_10.42.42.2(pid=14168): stderr: | 20221214054911466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054911466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054911466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054911466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054911466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054911466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054911479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054911489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054911489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054911489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:14.466283 run osmo-msc_10.42.42.6(pid=14174): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14174)] 05:49:14.515543 run osmo-msc_10.42.42.6(pid=14174): stdout: | (launched: 2022-12-14_05:49:13.323227) 05:49:14.566541 run osmo-msc_10.42.42.6(pid=14174): stderr: | 20221214054913643 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054913643 DLGLOBAL DEBUG validating counter group 0x7f92825aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054913643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054913643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054913643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054913643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054913645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054913645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054913646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054913646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:14.617917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14167): Terminating (SIGTERM) 05:49:14.659303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14170): Terminating (SIGTERM) 05:49:14.700537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14173): Terminating (SIGTERM) 05:49:14.742071 --- ParallelTerminationStrategy: PID 14167 died... 05:49:14.761878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14167): Terminated: ok {rc=0} 05:49:14.807574 --- ParallelTerminationStrategy: PID 14170 died... 05:49:14.826898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14170): Terminated: ok {rc=0} 05:49:14.872249 --- ParallelTerminationStrategy: PID 14173 died... 05:49:14.891816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14173): Terminated: ok {rc=0} 05:49:14.978657 bus /sierra_3: Setting Powered False 05:49:16.075081 bus /sierra_3: Setting Powered False 05:49:17.203883 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:49:18.353486 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:18.365733 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:49:18.438737 tst mo_mt_call_osmux.py: using LAC 38834 05:49:18.567912 tst mo_mt_call_osmux.py: using RAC 74 05:49:18.697415 tst mo_mt_call_osmux.py: using CellId 38834 05:49:18.820233 tst mo_mt_call_osmux.py: using BVCI 38835 05:49:18.932890 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:18.944178 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:18.955056 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:18.966166 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:18.977402 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:49:18.988513 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:49:19.104298 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:49:19.225501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:19.732161 run create_hlr_db(pid=14176): Launched 05:49:19.865165 bus /sierra_2: Setting Powered False 05:49:20.929211 run create_hlr_db(pid=14176): Terminated: ok {rc=0} 05:49:21.384009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14178): Launched 05:49:21.710960 run osmo-hlr_10.42.42.2(pid=14179): Launched 05:49:21.835272 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:22.397488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14181): Launched 05:49:22.723755 run osmo-stp_10.42.42.5(pid=14182): Launched 05:49:22.847438 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:23.435992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14184): Launched 05:49:23.763157 run osmo-msc_10.42.42.6(pid=14185): Launched 05:49:23.943875 run osmo-stp_10.42.42.5(pid=14182): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14182)] 05:49:24.081453 run osmo-stp_10.42.42.5(pid=14182): stdout: | (launched: 2022-12-14_05:49:22.664541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:24.218499 run osmo-stp_10.42.42.5(pid=14182): stderr: | 20221214054922855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054922855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054922856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054922856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054922857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054922857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054922857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:24.354234 run osmo-stp_10.42.42.5(pid=14182): stdout: | (launched: 2022-12-14_05:49:22.664541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:24.484439 run osmo-stp_10.42.42.5(pid=14182): stderr: | 20221214054922855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054922855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054922856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054922856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054922857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054922857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054922857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:24.639567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14182): Process ended prematurely: osmo-stp_10.42.42.5(pid=14182) [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14182)] [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:49:24.649268 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:49:24.677470 run osmo-hlr_10.42.42.2(pid=14179): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14179)] 05:49:24.727279 run osmo-hlr_10.42.42.2(pid=14179): stdout: | (launched: 2022-12-14_05:49:21.651792) 05:49:24.779023 run osmo-hlr_10.42.42.2(pid=14179): stderr: | 20221214054921846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054921846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054921846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054921846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054921846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054921846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054921859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054921867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054921868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054921868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:24.851023 run osmo-msc_10.42.42.6(pid=14185): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14185)] 05:49:24.900722 run osmo-msc_10.42.42.6(pid=14185): stdout: | (launched: 2022-12-14_05:49:23.702553) 05:49:24.952252 run osmo-msc_10.42.42.6(pid=14185): stderr: | 20221214054924024 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054924024 DLGLOBAL DEBUG validating counter group 0x7ffb222eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054924025 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054924025 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054924025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054924025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054924027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054924027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054924027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054924027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:25.004440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14178): Terminating (SIGTERM) 05:49:25.045759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14181): Terminating (SIGTERM) 05:49:25.087210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14184): Terminating (SIGTERM) 05:49:25.128835 --- ParallelTerminationStrategy: PID 14178 died... 05:49:25.148458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14178): Terminated: ok {rc=0} 05:49:25.194091 --- ParallelTerminationStrategy: PID 14181 died... 05:49:25.213482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14181): Terminated: ok {rc=0} 05:49:25.258963 --- ParallelTerminationStrategy: PID 14184 died... 05:49:25.278338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14184): Terminated: ok {rc=0} 05:49:25.365236 bus /sierra_3: Setting Powered False 05:49:26.463011 bus /sierra_3: Setting Powered False 05:49:27.574982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:49:28.828688 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:28.834889 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:49:28.868570 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:49:28.895796 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:49:28.947830 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:49:28.981807 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:49:29.008819 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:49:29.555217 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:49:29.604888 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:29.615864 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:49:29.689717 tst mo_mt_call.py: using LAC 38835 05:49:29.817811 tst mo_mt_call.py: using RAC 75 05:49:29.944440 tst mo_mt_call.py: using CellId 38835 05:49:30.070658 tst mo_mt_call.py: using BVCI 38836 05:49:30.189510 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:30.201000 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:30.212382 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:30.223472 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:30.234707 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:30.245901 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:30.363497 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:30.482245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:31.012576 run create_hlr_db(pid=14190): Launched 05:49:31.161488 bus /sierra_2: Setting Powered False 05:49:32.227689 run create_hlr_db(pid=14190): Terminated: ok {rc=0} 05:49:32.657993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14192): Launched 05:49:32.964655 run osmo-hlr_10.42.42.2(pid=14193): Launched 05:49:33.079721 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:33.604457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14195): Launched 05:49:33.911000 run osmo-stp_10.42.42.5(pid=14196): Launched 05:49:34.028330 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:34.583172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14198): Launched 05:49:34.890619 run osmo-msc_10.42.42.6(pid=14199): Launched 05:49:35.061775 run osmo-stp_10.42.42.5(pid=14196): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14196)] 05:49:35.191700 run osmo-stp_10.42.42.5(pid=14196): stdout: | (launched: 2022-12-14_05:49:33.854999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:35.321287 run osmo-stp_10.42.42.5(pid=14196): stderr: | 20221214054934023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054934023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054934024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054934024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054934025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054934025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054934025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:35.449498 run osmo-stp_10.42.42.5(pid=14196): stdout: | (launched: 2022-12-14_05:49:33.854999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:35.571184 run osmo-stp_10.42.42.5(pid=14196): stderr: | 20221214054934023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054934023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054934024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054934024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054934025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054934025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054934025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:35.716733 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14196): Process ended prematurely: osmo-stp_10.42.42.5(pid=14196) [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14196)] [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:49:35.725680 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:49:35.751867 run osmo-hlr_10.42.42.2(pid=14193): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14193)] 05:49:35.799991 run osmo-hlr_10.42.42.2(pid=14193): stdout: | (launched: 2022-12-14_05:49:32.908531) 05:49:35.848895 run osmo-hlr_10.42.42.2(pid=14193): stderr: | 20221214054933083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054933083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054933083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054933083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054933083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054933084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054933126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054933136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054933136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054933136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:35.917668 run osmo-msc_10.42.42.6(pid=14199): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14199)] 05:49:35.964598 run osmo-msc_10.42.42.6(pid=14199): stdout: | (launched: 2022-12-14_05:49:34.832713) 05:49:36.014177 run osmo-msc_10.42.42.6(pid=14199): stderr: | 20221214054935101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054935101 DLGLOBAL DEBUG validating counter group 0x7fbec3d71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054935102 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054935102 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054935102 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054935102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054935104 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054935104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054935104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054935104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:36.063514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14192): Terminating (SIGTERM) 05:49:36.103158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14195): Terminating (SIGTERM) 05:49:36.143296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14198): Terminating (SIGTERM) 05:49:36.183900 --- ParallelTerminationStrategy: PID 14192 died... 05:49:36.203395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14192): Terminated: ok {rc=0} 05:49:36.247616 --- ParallelTerminationStrategy: PID 14195 died... 05:49:36.266503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14195): Terminated: ok {rc=0} 05:49:36.310382 --- ParallelTerminationStrategy: PID 14198 died... 05:49:36.329250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14198): Terminated: ok {rc=0} 05:49:36.413160 bus /sierra_3: Setting Powered False 05:49:37.511057 bus /sierra_3: Setting Powered False 05:49:38.626633 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:49:39.775285 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:39.787333 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:49:39.860039 tst mo_mt_call_osmux.py: using LAC 38836 05:49:39.989819 tst mo_mt_call_osmux.py: using RAC 76 05:49:40.120854 tst mo_mt_call_osmux.py: using CellId 38836 05:49:40.249020 tst mo_mt_call_osmux.py: using BVCI 38837 05:49:40.367312 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:40.378821 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:40.390091 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:40.401232 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:40.412367 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:40.423939 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:40.543751 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:40.660838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:41.137597 run create_hlr_db(pid=14201): Launched 05:49:41.255158 bus /sierra_2: Setting Powered False 05:49:42.315883 run create_hlr_db(pid=14201): Terminated: ok {rc=0} 05:49:42.765421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14203): Launched 05:49:43.094097 run osmo-hlr_10.42.42.2(pid=14204): Launched 05:49:43.217871 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:43.782556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14206): Launched 05:49:44.109968 run osmo-stp_10.42.42.5(pid=14207): Launched 05:49:44.234984 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:44.826481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14209): Launched 05:49:45.154514 run osmo-msc_10.42.42.6(pid=14210): Launched 05:49:45.335861 run osmo-stp_10.42.42.5(pid=14207): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14207)] 05:49:45.473945 run osmo-stp_10.42.42.5(pid=14207): stdout: | (launched: 2022-12-14_05:49:44.050295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:45.611600 run osmo-stp_10.42.42.5(pid=14207): stderr: | 20221214054944240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054944240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054944241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054944241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054944242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054944242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054944242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:45.747827 run osmo-stp_10.42.42.5(pid=14207): stdout: | (launched: 2022-12-14_05:49:44.050295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:45.884451 run osmo-stp_10.42.42.5(pid=14207): stderr: | 20221214054944240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054944240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054944241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054944241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054944242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054944242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054944242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:46.047478 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14207): Process ended prematurely: osmo-stp_10.42.42.5(pid=14207) [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14207)] [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:49:46.057638 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:49:46.085312 run osmo-hlr_10.42.42.2(pid=14204): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14204)] 05:49:46.136777 run osmo-hlr_10.42.42.2(pid=14204): stdout: | (launched: 2022-12-14_05:49:43.034748) 05:49:46.191454 run osmo-hlr_10.42.42.2(pid=14204): stderr: | 20221214054943229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054943229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054943229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054943229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054943229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054943229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054943245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054943253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054943254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054943254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:46.263533 run osmo-msc_10.42.42.6(pid=14210): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14210)] 05:49:46.312590 run osmo-msc_10.42.42.6(pid=14210): stdout: | (launched: 2022-12-14_05:49:45.094338) 05:49:46.364549 run osmo-msc_10.42.42.6(pid=14210): stderr: | 20221214054945415 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054945415 DLGLOBAL DEBUG validating counter group 0x7fad95771c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054945415 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054945415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054945416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054945416 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054945417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054945418 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054945418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054945418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:46.419514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14203): Terminating (SIGTERM) 05:49:46.461556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14206): Terminating (SIGTERM) 05:49:46.506194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14209): Terminating (SIGTERM) 05:49:46.551287 --- ParallelTerminationStrategy: PID 14203 died... 05:49:46.572615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14203): Terminated: ok {rc=0} 05:49:46.621444 --- ParallelTerminationStrategy: PID 14206 died... 05:49:46.642429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14206): Terminated: ok {rc=0} 05:49:46.690368 --- ParallelTerminationStrategy: PID 14209 died... 05:49:46.711170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14209): Terminated: ok {rc=0} 05:49:46.805719 bus /sierra_3: Setting Powered False 05:49:47.918494 bus /sierra_3: Setting Powered False 05:49:49.033322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 05:49:50.286397 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:50.291473 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 05:49:50.323697 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 05:49:50.350567 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 05:49:50.400878 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 05:49:50.433058 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 05:49:50.459367 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 05:49:51.008167 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 05:49:51.057927 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:51.068787 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 05:49:51.118825 tst mo_mt_call.py: using LAC 38837 05:49:51.247176 tst mo_mt_call.py: using RAC 77 05:49:51.375714 tst mo_mt_call.py: using CellId 38837 05:49:51.505104 tst mo_mt_call.py: using BVCI 38838 05:49:51.623260 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:51.634721 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:51.645952 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:51.657093 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:51.668161 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:51.679372 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:51.798058 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:51.914544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:52.390814 run create_hlr_db(pid=14215): Launched 05:49:52.508909 bus /sierra_2: Setting Powered False 05:49:53.569893 run create_hlr_db(pid=14215): Terminated: ok {rc=0} 05:49:54.018194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14217): Launched 05:49:54.345489 run osmo-hlr_10.42.42.2(pid=14218): Launched 05:49:54.470172 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:55.034544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14220): Launched 05:49:55.360913 run osmo-stp_10.42.42.5(pid=14221): Launched 05:49:55.487554 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:56.077669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14223): Launched 05:49:56.404155 run osmo-msc_10.42.42.6(pid=14224): Launched 05:49:56.586898 run osmo-stp_10.42.42.5(pid=14221): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14221)] 05:49:56.724004 run osmo-stp_10.42.42.5(pid=14221): stdout: | (launched: 2022-12-14_05:49:55.301599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:56.861720 run osmo-stp_10.42.42.5(pid=14221): stderr: | 20221214054955491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054955492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054955492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054955492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054955493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054955493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054955493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:56.997056 run osmo-stp_10.42.42.5(pid=14221): stdout: | (launched: 2022-12-14_05:49:55.301599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:57.126449 run osmo-stp_10.42.42.5(pid=14221): stderr: | 20221214054955491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214054955492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214054955492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214054955492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214054955493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214054955493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214054955493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:57.281438 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14221): Process ended prematurely: osmo-stp_10.42.42.5(pid=14221) [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14221)] [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 05:49:57.290884 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:49:57.318017 run osmo-hlr_10.42.42.2(pid=14218): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14218)] 05:49:57.367475 run osmo-hlr_10.42.42.2(pid=14218): stdout: | (launched: 2022-12-14_05:49:54.285913) 05:49:57.418709 run osmo-hlr_10.42.42.2(pid=14218): stderr: | 20221214054954482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214054954482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214054954482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214054954482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214054954482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214054954482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214054954494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214054954504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214054954505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214054954505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:57.490439 run osmo-msc_10.42.42.6(pid=14224): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14224)] 05:49:57.539974 run osmo-msc_10.42.42.6(pid=14224): stdout: | (launched: 2022-12-14_05:49:56.344646) 05:49:57.590962 run osmo-msc_10.42.42.6(pid=14224): stderr: | 20221214054956664 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214054956664 DLGLOBAL DEBUG validating counter group 0x7f4931f61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214054956664 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214054956664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214054956664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214054956664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214054956666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214054956667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214054956667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214054956667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:57.642657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14217): Terminating (SIGTERM) 05:49:57.683867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14220): Terminating (SIGTERM) 05:49:57.725339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14223): Terminating (SIGTERM) 05:49:57.766911 --- ParallelTerminationStrategy: PID 14217 died... 05:49:57.786818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14217): Terminated: ok {rc=0} 05:49:57.832632 --- ParallelTerminationStrategy: PID 14220 died... 05:49:57.852138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14220): Terminated: ok {rc=0} 05:49:57.897631 --- ParallelTerminationStrategy: PID 14223 died... 05:49:57.917078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14223): Terminated: ok {rc=0} 05:49:58.004175 bus /sierra_3: Setting Powered False 05:49:59.102734 bus /sierra_3: Setting Powered False 05:50:00.218097 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 05:50:01.366522 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:50:01.380208 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 05:50:01.430172 tst mo_mt_call_osmux.py: using LAC 38838 05:50:01.593939 tst mo_mt_call_osmux.py: using RAC 78 05:50:01.719330 tst mo_mt_call_osmux.py: using CellId 38838 05:50:01.879025 tst mo_mt_call_osmux.py: using BVCI 38839 05:50:02.004393 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:50:02.016467 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:50:02.028417 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:50:02.040513 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:50:02.053789 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:50:02.067008 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:50:02.188240 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:50:02.334317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:02.846671 run create_hlr_db(pid=14229): Launched 05:50:02.978382 bus /sierra_2: Setting Powered False 05:50:04.042850 run create_hlr_db(pid=14229): Terminated: ok {rc=0} 05:50:04.497350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14231): Launched 05:50:04.822650 run osmo-hlr_10.42.42.2(pid=14232): Launched 05:50:04.945490 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:05.509560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14234): Launched 05:50:05.836058 run osmo-stp_10.42.42.5(pid=14235): Launched 05:50:05.959077 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:06.549954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14237): Launched 05:50:06.875182 run osmo-msc_10.42.42.6(pid=14238): Launched 05:50:07.055950 run osmo-stp_10.42.42.5(pid=14235): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14235)] 05:50:07.192611 run osmo-stp_10.42.42.5(pid=14235): stdout: | (launched: 2022-12-14_05:50:05.776743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:07.329901 run osmo-stp_10.42.42.5(pid=14235): stderr: | 20221214055005967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055005967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055005967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055005968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055005968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055005968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055005968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:07.465862 run osmo-stp_10.42.42.5(pid=14235): stdout: | (launched: 2022-12-14_05:50:05.776743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:07.595366 run osmo-stp_10.42.42.5(pid=14235): stderr: | 20221214055005967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055005967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055005967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055005968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055005968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055005968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055005968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:07.750389 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14235): Process ended prematurely: osmo-stp_10.42.42.5(pid=14235) [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14235)] [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 05:50:07.759940 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:50:07.787350 run osmo-hlr_10.42.42.2(pid=14232): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14232)] 05:50:07.837566 run osmo-hlr_10.42.42.2(pid=14232): stdout: | (launched: 2022-12-14_05:50:04.763605) 05:50:07.888822 run osmo-hlr_10.42.42.2(pid=14232): stderr: | 20221214055004959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055004959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055004959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055004959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055004959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055004959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055004971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055004980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055004981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055004981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:07.960303 run osmo-msc_10.42.42.6(pid=14238): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14238)] 05:50:08.009956 run osmo-msc_10.42.42.6(pid=14238): stdout: | (launched: 2022-12-14_05:50:06.816096) 05:50:08.061204 run osmo-msc_10.42.42.6(pid=14238): stderr: | 20221214055007134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055007134 DLGLOBAL DEBUG validating counter group 0x7fab5fa83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055007134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055007134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055007134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055007135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055007136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055007137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055007137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055007137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:08.112710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14231): Terminating (SIGTERM) 05:50:08.153801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14234): Terminating (SIGTERM) 05:50:08.195094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14237): Terminating (SIGTERM) 05:50:08.236611 --- ParallelTerminationStrategy: PID 14231 died... 05:50:08.256033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14231): Terminated: ok {rc=0} 05:50:08.301760 --- ParallelTerminationStrategy: PID 14234 died... 05:50:08.321073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14234): Terminated: ok {rc=0} 05:50:08.366503 --- ParallelTerminationStrategy: PID 14237 died... 05:50:08.385788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14237): Terminated: ok {rc=0} 05:50:08.473707 bus /sierra_3: Setting Powered False 05:50:09.568748 bus /sierra_3: Setting Powered False 05:50:10.683019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 05:50:11.932231 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:50:11.938783 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 05:50:11.972359 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 05:50:11.999751 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 05:50:12.051010 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 05:50:12.084798 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 05:50:12.111904 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 05:50:12.666771 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 05:50:12.719246 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:12.731079 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:50:12.782387 tst mo_mt_call.py: using LAC 38839 05:50:12.910359 tst mo_mt_call.py: using RAC 79 05:50:13.030745 tst mo_mt_call.py: using CellId 38839 05:50:13.151451 tst mo_mt_call.py: using BVCI 38840 05:50:13.264892 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:13.276234 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:13.287425 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:13.298484 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:13.309869 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:13.321216 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:50:13.441712 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:50:13.561709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:14.069345 run create_hlr_db(pid=14244): Launched 05:50:14.202331 bus /sierra_2: Setting Powered False 05:50:15.267125 run create_hlr_db(pid=14244): Terminated: ok {rc=0} 05:50:15.723926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14246): Launched 05:50:16.071704 run osmo-hlr_10.42.42.2(pid=14247): Launched 05:50:16.319279 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:16.993935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14249): Launched 05:50:17.340416 run osmo-stp_10.42.42.5(pid=14250): Launched 05:50:17.466245 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:18.061880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14252): Launched 05:50:18.390157 run osmo-msc_10.42.42.6(pid=14253): Launched 05:50:18.572905 run osmo-stp_10.42.42.5(pid=14250): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14250)] 05:50:18.710046 run osmo-stp_10.42.42.5(pid=14250): stdout: | (launched: 2022-12-14_05:50:17.276058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:18.847800 run osmo-stp_10.42.42.5(pid=14250): stderr: | 20221214055017475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055017475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055017475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055017475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055017476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055017476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055017476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:18.984115 run osmo-stp_10.42.42.5(pid=14250): stdout: | (launched: 2022-12-14_05:50:17.276058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:19.114244 run osmo-stp_10.42.42.5(pid=14250): stderr: | 20221214055017475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055017475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055017475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055017475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055017476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055017476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055017476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:19.269886 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14250): Process ended prematurely: osmo-stp_10.42.42.5(pid=14250) [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14250)] [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 05:50:19.279818 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 05:50:19.307704 run osmo-hlr_10.42.42.2(pid=14247): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14247)] 05:50:19.357423 run osmo-hlr_10.42.42.2(pid=14247): stdout: | (launched: 2022-12-14_05:50:16.007403) 05:50:19.409402 run osmo-hlr_10.42.42.2(pid=14247): stderr: | 20221214055016306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055016306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055016306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055016306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055016306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055016306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055016336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055016352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055016352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055016352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:19.481521 run osmo-msc_10.42.42.6(pid=14253): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14253)] 05:50:19.531231 run osmo-msc_10.42.42.6(pid=14253): stdout: | (launched: 2022-12-14_05:50:18.329330) 05:50:19.582486 run osmo-msc_10.42.42.6(pid=14253): stderr: | 20221214055018650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055018650 DLGLOBAL DEBUG validating counter group 0x7f60cd9d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055018650 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055018650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055018650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055018651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055018652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055018653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055018653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055018653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:19.634124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14246): Terminating (SIGTERM) 05:50:19.675989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14249): Terminating (SIGTERM) 05:50:19.717854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14252): Terminating (SIGTERM) 05:50:19.759951 --- ParallelTerminationStrategy: PID 14246 died... 05:50:19.779996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14246): Terminated: ok {rc=0} 05:50:19.826280 --- ParallelTerminationStrategy: PID 14249 died... 05:50:19.845925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14249): Terminated: ok {rc=0} 05:50:19.891867 --- ParallelTerminationStrategy: PID 14252 died... 05:50:19.911523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14252): Terminated: ok {rc=0} 05:50:19.999318 bus /sierra_3: Setting Powered False 05:50:21.098102 bus /sierra_3: Setting Powered False 05:50:22.214033 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 05:50:23.363345 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:23.375964 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:50:23.430638 tst mo_mt_call_osmux.py: using LAC 38840 05:50:23.560630 tst mo_mt_call_osmux.py: using RAC 80 05:50:23.690746 tst mo_mt_call_osmux.py: using CellId 38840 05:50:23.820415 tst mo_mt_call_osmux.py: using BVCI 38841 05:50:23.938809 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:23.950655 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:23.962354 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:23.974035 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:23.985787 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:50:23.997410 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:50:24.114629 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:50:24.238420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:24.744171 run create_hlr_db(pid=14255): Launched 05:50:24.876489 bus /sierra_2: Setting Powered False 05:50:25.941254 run create_hlr_db(pid=14255): Terminated: ok {rc=0} 05:50:26.378110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14257): Launched 05:50:26.685207 run osmo-hlr_10.42.42.2(pid=14258): Launched 05:50:26.801845 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:27.333661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14260): Launched 05:50:27.639312 run osmo-stp_10.42.42.5(pid=14261): Launched 05:50:27.754830 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:28.307368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14263): Launched 05:50:28.613550 run osmo-msc_10.42.42.6(pid=14264): Launched 05:50:28.784173 run osmo-stp_10.42.42.5(pid=14261): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14261)] 05:50:28.913722 run osmo-stp_10.42.42.5(pid=14261): stdout: | (launched: 2022-12-14_05:50:27.583256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:29.042876 run osmo-stp_10.42.42.5(pid=14261): stderr: | 20221214055027752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055027752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055027752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055027753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055027753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055027753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055027754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:29.169670 run osmo-stp_10.42.42.5(pid=14261): stdout: | (launched: 2022-12-14_05:50:27.583256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:29.290364 run osmo-stp_10.42.42.5(pid=14261): stderr: | 20221214055027752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055027752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055027752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055027753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055027753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055027753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055027754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:29.435549 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14261): Process ended prematurely: osmo-stp_10.42.42.5(pid=14261) [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14261)] [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 05:50:29.444703 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:50:29.470719 run osmo-hlr_10.42.42.2(pid=14258): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14258)] 05:50:29.517986 run osmo-hlr_10.42.42.2(pid=14258): stdout: | (launched: 2022-12-14_05:50:26.629147) 05:50:29.566538 run osmo-hlr_10.42.42.2(pid=14258): stderr: | 20221214055026801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055026801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055026801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055026801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055026801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055026801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055026815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055026824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055026824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055026824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:29.634703 run osmo-msc_10.42.42.6(pid=14264): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14264)] 05:50:29.681339 run osmo-msc_10.42.42.6(pid=14264): stdout: | (launched: 2022-12-14_05:50:28.557162) 05:50:29.729884 run osmo-msc_10.42.42.6(pid=14264): stderr: | 20221214055028827 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055028827 DLGLOBAL DEBUG validating counter group 0x7f7fb03c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055028827 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055028827 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055028827 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055028827 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055028829 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055028830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055028830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055028830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:29.778761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14257): Terminating (SIGTERM) 05:50:29.818157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14260): Terminating (SIGTERM) 05:50:29.857550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14263): Terminating (SIGTERM) 05:50:29.897105 --- ParallelTerminationStrategy: PID 14257 died... 05:50:29.916352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14257): Terminated: ok {rc=0} 05:50:29.959886 --- ParallelTerminationStrategy: PID 14260 died... 05:50:29.978591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14260): Terminated: ok {rc=0} 05:50:30.021827 --- ParallelTerminationStrategy: PID 14263 died... 05:50:30.040340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14263): Terminated: ok {rc=0} 05:50:30.125914 bus /sierra_3: Setting Powered False 05:50:31.232446 bus /sierra_3: Setting Powered False 05:50:32.364887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:trx-b200 --------------------------------------------------------------------- 05:50:33.612335 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:50:33.618060 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 05:50:33.651743 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:50:33.679382 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 05:50:33.764478 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 05:50:33.797959 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:50:33.824841 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 05:50:34.406828 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 05:50:34.412104 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:34.422692 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 05:50:34.471091 tst emergency_mo_mt_call.py: using LAC 38841 05:50:34.589518 tst emergency_mo_mt_call.py: using RAC 81 05:50:34.717736 tst emergency_mo_mt_call.py: using CellId 38841 05:50:34.847978 tst emergency_mo_mt_call.py: using BVCI 38842 05:50:34.966235 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:34.977426 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:34.988223 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:34.999178 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:35.010098 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:35.020844 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:35.136276 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:35.255254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:35.752785 run create_hlr_db(pid=14269): Launched 05:50:35.873704 bus /sierra_2: Setting Powered False 05:50:36.933461 run create_hlr_db(pid=14269): Terminated: ok {rc=0} 05:50:37.372775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14271): Launched 05:50:37.692789 run osmo-hlr_10.42.42.2(pid=14272): Launched 05:50:37.814890 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:38.368112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14274): Launched 05:50:38.689880 run osmo-stp_10.42.42.5(pid=14275): Launched 05:50:38.821620 tst emergency_mo_mt_call.py: using MSISDN 8529 05:50:38.985754 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:39.562942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14277): Launched 05:50:39.883281 run osmo-msc_10.42.42.6(pid=14278): Launched 05:50:40.063508 run osmo-stp_10.42.42.5(pid=14275): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14275)] 05:50:40.198764 run osmo-stp_10.42.42.5(pid=14275): stdout: | (launched: 2022-12-14_05:50:38.630833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:40.334381 run osmo-stp_10.42.42.5(pid=14275): stderr: | 20221214055038823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055038823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055038823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055038823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055038824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055038824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055038824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:40.468439 run osmo-stp_10.42.42.5(pid=14275): stdout: | (launched: 2022-12-14_05:50:38.630833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:40.596137 run osmo-stp_10.42.42.5(pid=14275): stderr: | 20221214055038823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055038823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055038823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055038823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055038824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055038824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055038824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:40.749111 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14275): Process ended prematurely: osmo-stp_10.42.42.5(pid=14275) [trial-2400↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14275)] [trial-2400↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 05:50:40.758070 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 05:50:40.785249 run osmo-hlr_10.42.42.2(pid=14272): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14272)] 05:50:40.834596 run osmo-hlr_10.42.42.2(pid=14272): stdout: | (launched: 2022-12-14_05:50:37.634460) 05:50:40.885895 run osmo-hlr_10.42.42.2(pid=14272): stderr: | 20221214055037830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055037830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055037830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055037830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055037830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055037830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055037843 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055037851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055037852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055037852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:40.957165 run osmo-msc_10.42.42.6(pid=14278): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14278)] 05:50:41.006610 run osmo-msc_10.42.42.6(pid=14278): stdout: | (launched: 2022-12-14_05:50:39.824646) 05:50:41.057685 run osmo-msc_10.42.42.6(pid=14278): stderr: | 20221214055040142 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055040142 DLGLOBAL DEBUG validating counter group 0x7fec43ea1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055040143 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055040143 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055040143 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055040143 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055040145 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055040145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055040145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055040146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:41.109113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14271): Terminating (SIGTERM) 05:50:41.150390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14274): Terminating (SIGTERM) 05:50:41.191797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14277): Terminating (SIGTERM) 05:50:41.233524 --- ParallelTerminationStrategy: PID 14271 died... 05:50:41.253437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14271): Terminated: ok {rc=0} 05:50:41.299170 --- ParallelTerminationStrategy: PID 14274 died... 05:50:41.318661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14274): Terminated: ok {rc=0} 05:50:41.364162 --- ParallelTerminationStrategy: PID 14277 died... 05:50:41.383653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14277): Terminated: ok {rc=0} 05:50:41.470645 bus /sierra_3: Setting Powered False 05:50:42.568074 bus /sierra_3: Setting Powered False 05:50:43.683053 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 05:50:44.769338 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:44.781177 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 05:50:44.831266 tst emergency_preemptive_call.py: using LAC 38842 05:50:44.951982 tst emergency_preemptive_call.py: using RAC 82 05:50:45.069910 tst emergency_preemptive_call.py: using CellId 38842 05:50:45.189056 tst emergency_preemptive_call.py: using BVCI 38843 05:50:45.307361 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:45.318877 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:45.330154 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:45.341360 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:45.353098 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:45.364709 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:45.480579 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:45.599567 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:45.715398 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:45.839499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:46.377015 run create_hlr_db(pid=14280): Launched 05:50:46.542589 bus /sierra_2: Setting Powered False 05:50:47.606580 run create_hlr_db(pid=14280): Terminated: ok {rc=0} 05:50:48.041047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14282): Launched 05:50:48.340839 run osmo-hlr_10.42.42.2(pid=14283): Launched 05:50:48.456380 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:48.985318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14285): Launched 05:50:49.284562 run osmo-stp_10.42.42.5(pid=14286): Launched 05:50:49.410428 tst emergency_preemptive_call.py: using MSISDN 8530 05:50:49.563748 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:50.101373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14288): Launched 05:50:50.401102 run osmo-msc_10.42.42.6(pid=14289): Launched 05:50:50.569317 run osmo-stp_10.42.42.5(pid=14286): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14286)] 05:50:50.696711 run osmo-stp_10.42.42.5(pid=14286): stdout: | (launched: 2022-12-14_05:50:49.229339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:50.824054 run osmo-stp_10.42.42.5(pid=14286): stderr: | 20221214055049397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055049397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055049397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055049398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055049398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055049398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055049398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:50.949108 run osmo-stp_10.42.42.5(pid=14286): stdout: | (launched: 2022-12-14_05:50:49.229339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:51.068142 run osmo-stp_10.42.42.5(pid=14286): stderr: | 20221214055049397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055049397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055049397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055049398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055049398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055049398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055049398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:51.210810 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14286): Process ended prematurely: osmo-stp_10.42.42.5(pid=14286) [trial-2400↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14286)] [trial-2400↪emergency:trx-b200↪emergency_preemptive_call.py:32] 05:50:51.219218 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 05:50:51.245323 run osmo-hlr_10.42.42.2(pid=14283): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14283)] 05:50:51.294458 run osmo-hlr_10.42.42.2(pid=14283): stdout: | (launched: 2022-12-14_05:50:48.285629) 05:50:51.343951 run osmo-hlr_10.42.42.2(pid=14283): stderr: | 20221214055048458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055048458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055048458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055048458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055048458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055048458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055048471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055048480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055048480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055048480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:51.413818 run osmo-msc_10.42.42.6(pid=14289): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14289)] 05:50:51.461341 run osmo-msc_10.42.42.6(pid=14289): stdout: | (launched: 2022-12-14_05:50:50.346048) 05:50:51.510759 run osmo-msc_10.42.42.6(pid=14289): stderr: | 20221214055050614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055050614 DLGLOBAL DEBUG validating counter group 0x7f0cf938ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055050614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055050614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055050614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055050615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055050616 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055050617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055050617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055050617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:51.560170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14282): Terminating (SIGTERM) 05:50:51.599963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14285): Terminating (SIGTERM) 05:50:51.639950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14288): Terminating (SIGTERM) 05:50:51.679957 --- ParallelTerminationStrategy: PID 14282 died... 05:50:51.699345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14282): Terminated: ok {rc=0} 05:50:51.743755 --- ParallelTerminationStrategy: PID 14285 died... 05:50:51.762542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14285): Terminated: ok {rc=0} 05:50:51.806411 --- ParallelTerminationStrategy: PID 14288 died... 05:50:51.825382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14288): Terminated: ok {rc=0} 05:50:51.910912 bus /sierra_9: Setting Powered False 05:50:53.015620 bus /sierra_9: Setting Powered False 05:50:54.131918 bus /sierra_8: Setting Powered False 05:50:55.228448 bus /sierra_8: Setting Powered False 05:50:56.344472 bus /sierra_3: Setting Powered False 05:50:57.443959 bus /sierra_3: Setting Powered False 05:50:58.560355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-b200 --------------------------------------------------------------------- 05:50:59.836338 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:50:59.841172 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 05:50:59.873388 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 05:50:59.911292 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 05:50:59.996899 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 05:51:00.029177 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 05:51:00.066723 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 05:51:00.655870 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 05:51:00.706098 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:00.716573 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:00.764385 tst cs_paging_gprs_active.py: using LAC 38843 05:51:00.899256 tst cs_paging_gprs_active.py: using RAC 83 05:51:01.047971 tst cs_paging_gprs_active.py: using CellId 38843 05:51:01.178363 tst cs_paging_gprs_active.py: using BVCI 38844 05:51:01.331862 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.346809 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.361508 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.376828 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.391834 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.405408 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.417365 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.429645 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:01.442261 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:01.587721 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:01.728180 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:51:01.941605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:02.261733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14295): Launched 05:51:02.540727 run iperf3-srv_10.42.42.10(pid=14296): Launched 05:51:02.655903 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:51:02.862304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:03.171468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14297): Launched 05:51:03.439562 run iperf3-srv_10.42.42.10(pid=14298): Launched 05:51:03.555203 tst cs_paging_gprs_active.py:38: start network... 05:51:03.761480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:04.237546 run create_hlr_db(pid=14299): Launched 05:51:04.355421 bus /sierra_2: Setting Powered False 05:51:05.416634 run create_hlr_db(pid=14299): Terminated: ok {rc=0} 05:51:05.845755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14301): Launched 05:51:06.174704 run osmo-hlr_10.42.42.2(pid=14302): Launched 05:51:06.299403 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:06.867592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14304): Launched 05:51:07.195499 run osmo-stp_10.42.42.5(pid=14305): Launched 05:51:07.319062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:07.885922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14307): Launched 05:51:08.011356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:08.288805 run patchelf(pid=14308): Launched 05:51:08.471459 run osmo-stp_10.42.42.5(pid=14305): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14305)] 05:51:08.610335 run osmo-stp_10.42.42.5(pid=14305): stdout: | (launched: 2022-12-14_05:51:07.135864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:08.751035 run osmo-stp_10.42.42.5(pid=14305): stderr: | 20221214055107324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055107324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055107324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055107325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055107325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055107325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055107325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:08.891996 run osmo-stp_10.42.42.5(pid=14305): stdout: | (launched: 2022-12-14_05:51:07.135864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:09.026312 run osmo-stp_10.42.42.5(pid=14305): stderr: | 20221214055107324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055107324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055107324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055107325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055107325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055107325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055107325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:09.184581 run patchelf(pid=14308): Terminating (SIGINT) 05:51:09.367515 run patchelf(pid=14308): Terminated: ok {rc=0} 05:51:09.499935 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14305): Process ended prematurely: osmo-stp_10.42.42.5(pid=14305) [trial-2400↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14305)] [trial-2400↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 05:51:09.510311 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:51:09.538745 run osmo-hlr_10.42.42.2(pid=14302): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14302)] 05:51:09.588032 run osmo-hlr_10.42.42.2(pid=14302): stdout: | (launched: 2022-12-14_05:51:06.115188) 05:51:09.639121 run osmo-hlr_10.42.42.2(pid=14302): stderr: | 20221214055106311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055106311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055106311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055106311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055106311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055106311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055106324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055106332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055106333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055106333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:09.690743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14295): Terminating (SIGTERM) 05:51:09.732359 run iperf3-srv_10.42.42.10(pid=14296): Terminating (SIGTERM) 05:51:09.773935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14297): Terminating (SIGTERM) 05:51:09.815242 run iperf3-srv_10.42.42.10(pid=14298): Terminating (SIGTERM) 05:51:09.856487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14301): Terminating (SIGTERM) 05:51:09.898110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14304): Terminating (SIGTERM) 05:51:09.939514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14307): Terminating (SIGTERM) 05:51:09.981615 --- ParallelTerminationStrategy: PID 14295 died... 05:51:10.001635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14295): Terminated: ok {rc=0} 05:51:10.048053 --- ParallelTerminationStrategy: PID 14296 died... 05:51:10.067603 run iperf3-srv_10.42.42.10(pid=14296): Terminated {rc=256} 05:51:10.113225 --- ParallelTerminationStrategy: PID 14297 died... 05:51:10.132444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14297): Terminated: ok {rc=0} 05:51:10.178013 --- ParallelTerminationStrategy: PID 14298 died... 05:51:10.197499 run iperf3-srv_10.42.42.10(pid=14298): Terminated {rc=256} 05:51:10.242847 --- ParallelTerminationStrategy: PID 14301 died... 05:51:10.262458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14301): Terminated: ok {rc=0} 05:51:10.308002 --- ParallelTerminationStrategy: PID 14304 died... 05:51:10.327424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14304): Terminated: ok {rc=0} 05:51:10.373082 --- ParallelTerminationStrategy: PID 14307 died... 05:51:10.392506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14307): Terminated: ok {rc=0} 05:51:10.480601 bus /gobi_0: Setting Powered False 05:51:11.579485 bus /gobi_0: Setting Powered False 05:51:12.696034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200 iperf3.py ---------------------------------------------- 05:51:13.845737 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:13.857558 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:13.909847 tst iperf3.py: using LAC 38844 05:51:14.040276 tst iperf3.py: using RAC 84 05:51:14.169887 tst iperf3.py: using CellId 38844 05:51:14.305146 tst iperf3.py: using BVCI 38845 05:51:14.426462 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.437888 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.448751 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.459645 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.470984 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.482029 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.493275 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.504256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.515378 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:14.632845 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:51:14.855085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:15.184659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14309): Launched 05:51:15.469393 run iperf3-srv_10.42.42.10(pid=14310): Launched 05:51:15.591649 tst iperf3.py:8: start network... 05:51:15.812373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:16.334291 run create_hlr_db(pid=14311): Launched 05:51:16.498774 bus /gobi_6: Setting Powered False 05:51:17.563413 run create_hlr_db(pid=14311): Terminated: ok {rc=0} 05:51:18.000692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14313): Launched 05:51:18.307269 run osmo-hlr_10.42.42.2(pid=14314): Launched 05:51:18.423943 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:18.966438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14316): Launched 05:51:19.273712 run osmo-stp_10.42.42.5(pid=14317): Launched 05:51:19.390868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:19.918621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14319): Launched 05:51:20.037111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:20.296637 run patchelf(pid=14320): Launched 05:51:20.467951 run osmo-stp_10.42.42.5(pid=14317): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14317)] 05:51:20.598666 run osmo-stp_10.42.42.5(pid=14317): stdout: | (launched: 2022-12-14_05:51:19.217809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:20.730810 run osmo-stp_10.42.42.5(pid=14317): stderr: | 20221214055119387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055119388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055119388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055119388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055119389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055119389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055119389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:20.862664 run osmo-stp_10.42.42.5(pid=14317): stdout: | (launched: 2022-12-14_05:51:19.217809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:20.988798 run osmo-stp_10.42.42.5(pid=14317): stderr: | 20221214055119387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055119388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055119388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055119388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055119389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055119389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055119389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:21.137817 run patchelf(pid=14320): Terminating (SIGINT) 05:51:21.310061 run patchelf(pid=14320): Terminated: ok {rc=0} 05:51:21.434605 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14317): Process ended prematurely: osmo-stp_10.42.42.5(pid=14317) [trial-2400↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14317)] [trial-2400↪gprs:trx-b200↪iperf3.py:8] 05:51:21.444242 tst iperf3.py:8: Test FAILED (7.6 sec) 05:51:21.471364 run osmo-hlr_10.42.42.2(pid=14314): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14314)] 05:51:21.518896 run osmo-hlr_10.42.42.2(pid=14314): stdout: | (launched: 2022-12-14_05:51:18.251575) 05:51:21.567964 run osmo-hlr_10.42.42.2(pid=14314): stderr: | 20221214055118423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055118423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055118423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055118423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055118423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055118423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055118435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055118443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055118444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055118444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:21.617537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14309): Terminating (SIGTERM) 05:51:21.657691 run iperf3-srv_10.42.42.10(pid=14310): Terminating (SIGTERM) 05:51:21.697675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14313): Terminating (SIGTERM) 05:51:21.737903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14316): Terminating (SIGTERM) 05:51:21.777698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14319): Terminating (SIGTERM) 05:51:21.817969 --- ParallelTerminationStrategy: PID 14309 died... 05:51:21.837564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14309): Terminated: ok {rc=0} 05:51:21.881692 --- ParallelTerminationStrategy: PID 14310 died... 05:51:21.900419 run iperf3-srv_10.42.42.10(pid=14310): Terminated {rc=256} 05:51:21.944346 --- ParallelTerminationStrategy: PID 14313 died... 05:51:21.963128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14313): Terminated: ok {rc=0} 05:51:22.006833 --- ParallelTerminationStrategy: PID 14316 died... 05:51:22.025754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14316): Terminated: ok {rc=0} 05:51:22.069498 --- ParallelTerminationStrategy: PID 14319 died... 05:51:22.088380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14319): Terminated: ok {rc=0} 05:51:22.174312 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 05:51:23.324184 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.336054 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:23.387330 tst iperf3m4.py: using LAC 38845 05:51:23.517243 tst iperf3m4.py: using RAC 85 05:51:23.645407 tst iperf3m4.py: using CellId 38845 05:51:23.765352 tst iperf3m4.py: using BVCI 38846 05:51:23.876756 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.887749 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.898510 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.909134 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.919987 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.930671 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.941613 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.952347 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.963292 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:24.079044 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:24.200334 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:24.318092 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:24.432687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:51:24.639083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:24.947991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14321): Launched 05:51:25.217367 run iperf3-srv_10.42.42.10(pid=14322): Launched 05:51:25.332708 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:51:25.539060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:25.847229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14323): Launched 05:51:26.114420 run iperf3-srv_10.42.42.10(pid=14324): Launched 05:51:26.229808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:51:26.435596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:26.744319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14325): Launched 05:51:27.012208 run iperf3-srv_10.42.42.10(pid=14326): Launched 05:51:27.128399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:51:27.334232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:27.643484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14327): Launched 05:51:27.910685 run iperf3-srv_10.42.42.10(pid=14328): Launched 05:51:28.025833 tst iperf3m4.py:8: start network... 05:51:28.231688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:28.707314 run create_hlr_db(pid=14329): Launched 05:51:28.823942 bus /gobi_6: Setting Powered False 05:51:29.885373 run create_hlr_db(pid=14329): Terminated: ok {rc=0} 05:51:30.312259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Launched 05:51:30.619499 run osmo-hlr_10.42.42.2(pid=14332): Launched 05:51:30.735751 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:31.413681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Launched 05:51:31.735313 run osmo-stp_10.42.42.5(pid=14335): Launched 05:51:32.037719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:32.610819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14337): Launched 05:51:32.736901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:33.015917 run patchelf(pid=14338): Launched 05:51:33.202402 run osmo-stp_10.42.42.5(pid=14335): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] 05:51:33.344273 run osmo-stp_10.42.42.5(pid=14335): stdout: | (launched: 2022-12-14_05:51:31.675719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:33.488241 run osmo-stp_10.42.42.5(pid=14335): stderr: | 20221214055131892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055131892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055131892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055131893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055131893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055131893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055131893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:33.631844 run osmo-stp_10.42.42.5(pid=14335): stdout: | (launched: 2022-12-14_05:51:31.675719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:33.769226 run osmo-stp_10.42.42.5(pid=14335): stderr: | 20221214055131892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055131892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055131892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055131893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055131893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055131893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055131893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:33.932033 run patchelf(pid=14338): Terminating (SIGINT) 05:51:34.119318 run patchelf(pid=14338): Terminated: ok {rc=0} 05:51:34.254276 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14335): Process ended prematurely: osmo-stp_10.42.42.5(pid=14335) [trial-2400↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] [trial-2400↪gprs:trx-b200↪iperf3m4.py:8] 05:51:34.264780 tst iperf3m4.py:8: Test FAILED (11.0 sec) 05:51:34.293899 run osmo-hlr_10.42.42.2(pid=14332): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14332)] 05:51:34.344938 run osmo-hlr_10.42.42.2(pid=14332): stdout: | (launched: 2022-12-14_05:51:30.562826) 05:51:34.397489 run osmo-hlr_10.42.42.2(pid=14332): stderr: | 20221214055130735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055130735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055130735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055130735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055130735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055130735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055130747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055130755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055130755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055130756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:34.450360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14321): Terminating (SIGTERM) 05:51:34.493340 run iperf3-srv_10.42.42.10(pid=14322): Terminating (SIGTERM) 05:51:34.536243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14323): Terminating (SIGTERM) 05:51:34.579599 run iperf3-srv_10.42.42.10(pid=14324): Terminating (SIGTERM) 05:51:34.622544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14325): Terminating (SIGTERM) 05:51:34.665642 run iperf3-srv_10.42.42.10(pid=14326): Terminating (SIGTERM) 05:51:34.708432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14327): Terminating (SIGTERM) 05:51:34.751022 run iperf3-srv_10.42.42.10(pid=14328): Terminating (SIGTERM) 05:51:34.793858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Terminating (SIGTERM) 05:51:34.836450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Terminating (SIGTERM) 05:51:34.879437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14337): Terminating (SIGTERM) 05:51:34.922414 --- ParallelTerminationStrategy: PID 14321 died... 05:51:34.943023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14321): Terminated: ok {rc=0} 05:51:34.990207 --- ParallelTerminationStrategy: PID 14322 died... 05:51:35.010162 run iperf3-srv_10.42.42.10(pid=14322): Terminated {rc=256} 05:51:35.057021 --- ParallelTerminationStrategy: PID 14323 died... 05:51:35.076903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14323): Terminated: ok {rc=0} 05:51:35.124375 --- ParallelTerminationStrategy: PID 14324 died... 05:51:35.144304 run iperf3-srv_10.42.42.10(pid=14324): Terminated {rc=256} 05:51:35.191117 --- ParallelTerminationStrategy: PID 14325 died... 05:51:35.211103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14325): Terminated: ok {rc=0} 05:51:35.258132 --- ParallelTerminationStrategy: PID 14326 died... 05:51:35.278147 run iperf3-srv_10.42.42.10(pid=14326): Terminated {rc=256} 05:51:35.325187 --- ParallelTerminationStrategy: PID 14327 died... 05:51:35.345070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14327): Terminated: ok {rc=0} 05:51:35.392048 --- ParallelTerminationStrategy: PID 14328 died... 05:51:35.412121 run iperf3-srv_10.42.42.10(pid=14328): Terminated {rc=256} 05:51:35.458984 --- ParallelTerminationStrategy: PID 14331 died... 05:51:35.479143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Terminated: ok {rc=0} 05:51:35.526018 --- ParallelTerminationStrategy: PID 14334 died... 05:51:35.546228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Terminated: ok {rc=0} 05:51:35.593083 --- ParallelTerminationStrategy: PID 14337 died... 05:51:35.613104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14337): Terminated: ok {rc=0} 05:51:35.702468 bus /gobi_4: Setting Powered False 05:51:36.801333 bus /gobi_4: Setting Powered False 05:51:37.918343 bus /gobi_1: Setting Powered False 05:51:39.017996 bus /gobi_1: Setting Powered False 05:51:40.133436 bus /gobi_0: Setting Powered False 05:51:41.232307 bus /gobi_0: Setting Powered False 05:51:42.349689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200 ping.py ---------------------------------------------- 05:51:43.452452 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:43.463642 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:43.512755 tst ping.py: using LAC 38846 05:51:43.636901 tst ping.py: using RAC 86 05:51:43.758389 tst ping.py: using CellId 38846 05:51:43.881387 tst ping.py: using BVCI 38847 05:51:43.994687 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.005478 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.016094 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.026688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.037144 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.048819 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.059782 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:44.071147 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:44.191657 tst ping.py:19: start network... 05:51:44.415309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:44.925999 run create_hlr_db(pid=14340): Launched 05:51:45.059608 bus /gobi_6: Setting Powered False 05:51:46.130142 run create_hlr_db(pid=14340): Terminated: ok {rc=0} 05:51:46.570310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14342): Launched 05:51:46.905410 run osmo-hlr_10.42.42.2(pid=14343): Launched 05:51:47.037305 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:47.650237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14345): Launched 05:51:47.978594 run osmo-stp_10.42.42.5(pid=14346): Launched 05:51:48.106186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:48.674428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14348): Launched 05:51:48.799531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:49.077658 run patchelf(pid=14349): Launched 05:51:49.260359 run osmo-stp_10.42.42.5(pid=14346): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14346)] 05:51:49.399780 run osmo-stp_10.42.42.5(pid=14346): stdout: | (launched: 2022-12-14_05:51:47.918864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:49.540865 run osmo-stp_10.42.42.5(pid=14346): stderr: | 20221214055148114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055148114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055148114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055148114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055148115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055148115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055148115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:49.681995 run osmo-stp_10.42.42.5(pid=14346): stdout: | (launched: 2022-12-14_05:51:47.918864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:49.816507 run osmo-stp_10.42.42.5(pid=14346): stderr: | 20221214055148114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055148114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055148114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055148114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055148115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055148115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055148115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:49.976317 run patchelf(pid=14349): Terminating (SIGINT) 05:51:50.160578 run patchelf(pid=14349): Terminated: ok {rc=0} 05:51:50.292861 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14346): Process ended prematurely: osmo-stp_10.42.42.5(pid=14346) [trial-2400↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14346)] [trial-2400↪gprs:trx-b200↪ping.py:22] 05:51:50.302507 tst ping.py:22: Test FAILED (6.8 sec) 05:51:50.330862 run osmo-hlr_10.42.42.2(pid=14343): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14343)] 05:51:50.381356 run osmo-hlr_10.42.42.2(pid=14343): stdout: | (launched: 2022-12-14_05:51:46.845254) 05:51:50.433862 run osmo-hlr_10.42.42.2(pid=14343): stderr: | 20221214055147249 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055147249 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055147249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055147249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055147249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055147249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055147273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055147281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055147281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055147282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:50.486863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14342): Terminating (SIGTERM) 05:51:50.529264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14345): Terminating (SIGTERM) 05:51:50.572296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14348): Terminating (SIGTERM) 05:51:50.614861 --- ParallelTerminationStrategy: PID 14342 died... 05:51:50.635190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14342): Terminated: ok {rc=0} 05:51:50.681823 --- ParallelTerminationStrategy: PID 14345 died... 05:51:50.701784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14345): Terminated: ok {rc=0} 05:51:50.748276 --- ParallelTerminationStrategy: PID 14348 died... 05:51:50.768080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14348): Terminated: ok {rc=0} 05:51:50.856462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 05:51:51.946027 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:51.957946 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:52.012873 tst ping_idle_ping.py: using LAC 38847 05:51:52.143058 tst ping_idle_ping.py: using RAC 87 05:51:52.271549 tst ping_idle_ping.py: using CellId 38847 05:51:52.404648 tst ping_idle_ping.py: using BVCI 38848 05:51:52.527764 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.539031 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.550116 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.561261 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.572705 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.584265 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.595831 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:52.607325 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:52.726069 tst ping_idle_ping.py:24: start network... 05:51:52.949882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:53.464750 run create_hlr_db(pid=14350): Launched 05:51:53.598555 bus /gobi_6: Setting Powered False 05:51:54.663716 run create_hlr_db(pid=14350): Terminated: ok {rc=0} 05:51:55.106947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14352): Launched 05:51:55.417745 run osmo-hlr_10.42.42.2(pid=14353): Launched 05:51:55.537086 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:56.080844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14355): Launched 05:51:56.390410 run osmo-stp_10.42.42.5(pid=14356): Launched 05:51:56.509226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:57.044705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14358): Launched 05:51:57.163288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:57.426906 run patchelf(pid=14359): Launched 05:51:57.599793 run osmo-stp_10.42.42.5(pid=14356): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14356)] 05:51:57.731239 run osmo-stp_10.42.42.5(pid=14356): stdout: | (launched: 2022-12-14_05:51:56.333616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:57.864271 run osmo-stp_10.42.42.5(pid=14356): stderr: | 20221214055156504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055156504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055156504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055156505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055156505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055156505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055156505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:57.997324 run osmo-stp_10.42.42.5(pid=14356): stdout: | (launched: 2022-12-14_05:51:56.333616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:58.124214 run osmo-stp_10.42.42.5(pid=14356): stderr: | 20221214055156504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055156504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055156504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055156505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055156505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055156505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055156505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:58.275422 run patchelf(pid=14359): Terminating (SIGINT) 05:51:58.448591 run patchelf(pid=14359): Terminated: ok {rc=0} 05:51:58.573788 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14356): Process ended prematurely: osmo-stp_10.42.42.5(pid=14356) [trial-2400↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14356)] [trial-2400↪gprs:trx-b200↪ping_idle_ping.py:27] 05:51:58.582933 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:51:58.609943 run osmo-hlr_10.42.42.2(pid=14353): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14353)] 05:51:58.658801 run osmo-hlr_10.42.42.2(pid=14353): stdout: | (launched: 2022-12-14_05:51:55.361232) 05:51:58.709703 run osmo-hlr_10.42.42.2(pid=14353): stderr: | 20221214055155538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055155538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055155538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055155538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055155538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055155538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055155550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055155558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055155558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055155558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:58.760452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14352): Terminating (SIGTERM) 05:51:58.801347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14355): Terminating (SIGTERM) 05:51:58.842165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14358): Terminating (SIGTERM) 05:51:58.882946 --- ParallelTerminationStrategy: PID 14352 died... 05:51:58.903009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14352): Terminated: ok {rc=0} 05:51:58.948261 --- ParallelTerminationStrategy: PID 14355 died... 05:51:58.967521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14355): Terminated: ok {rc=0} 05:51:59.012430 --- ParallelTerminationStrategy: PID 14358 died... 05:51:59.031755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14358): Terminated: ok {rc=0} 05:51:59.117252 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 05:52:00.420752 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:52:00.426328 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:52:00.458759 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:52:00.498891 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:52:00.585927 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:52:00.618307 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:52:00.656682 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:52:01.297932 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:52:01.373609 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:01.390019 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:01.457601 tst cs_paging_gprs_active.py: using LAC 38848 05:52:01.584769 tst cs_paging_gprs_active.py: using RAC 88 05:52:01.717155 tst cs_paging_gprs_active.py: using CellId 38848 05:52:01.871015 tst cs_paging_gprs_active.py: using BVCI 38849 05:52:02.030732 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.044860 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.059794 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.074701 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.089565 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.103828 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.116550 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.130688 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:02.145393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:02.271625 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:02.393897 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:52:02.622933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:02.959916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14363): Launched 05:52:03.251957 run iperf3-srv_10.42.42.10(pid=14364): Launched 05:52:03.378319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:52:03.606032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:03.943853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14365): Launched 05:52:04.234851 run iperf3-srv_10.42.42.10(pid=14366): Launched 05:52:04.361674 tst cs_paging_gprs_active.py:38: start network... 05:52:04.588862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:05.107409 run create_hlr_db(pid=14367): Launched 05:52:05.244640 bus /gobi_6: Setting Powered False 05:52:06.310169 run create_hlr_db(pid=14367): Terminated: ok {rc=0} 05:52:06.758123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14369): Launched 05:52:07.073675 run osmo-hlr_10.42.42.2(pid=14370): Launched 05:52:07.194098 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:07.750257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14372): Launched 05:52:08.064790 run osmo-stp_10.42.42.5(pid=14373): Launched 05:52:08.185158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:08.727086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14375): Launched 05:52:08.848650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:09.114663 run patchelf(pid=14376): Launched 05:52:09.289326 run osmo-stp_10.42.42.5(pid=14373): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14373)] 05:52:09.423468 run osmo-stp_10.42.42.5(pid=14373): stdout: | (launched: 2022-12-14_05:52:08.007307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:09.559180 run osmo-stp_10.42.42.5(pid=14373): stderr: | 20221214055208177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055208177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055208178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055208178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055208179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055208179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055208179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:09.694440 run osmo-stp_10.42.42.5(pid=14373): stdout: | (launched: 2022-12-14_05:52:08.007307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:09.823458 run osmo-stp_10.42.42.5(pid=14373): stderr: | 20221214055208177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055208177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055208178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055208178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055208179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055208179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055208179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:09.976194 run patchelf(pid=14376): Terminating (SIGINT) 05:52:10.153553 run patchelf(pid=14376): Terminated: ok {rc=0} 05:52:10.281484 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14373): Process ended prematurely: osmo-stp_10.42.42.5(pid=14373) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14373)] [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:52:10.291224 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 05:52:10.318534 run osmo-hlr_10.42.42.2(pid=14370): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14370)] 05:52:10.366827 run osmo-hlr_10.42.42.2(pid=14370): stdout: | (launched: 2022-12-14_05:52:07.016338) 05:52:10.416609 run osmo-hlr_10.42.42.2(pid=14370): stderr: | 20221214055207194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055207194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055207195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055207195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055207195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055207195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055207210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055207218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055207219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055207219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:10.466706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14363): Terminating (SIGTERM) 05:52:10.507269 run iperf3-srv_10.42.42.10(pid=14364): Terminating (SIGTERM) 05:52:10.547916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14365): Terminating (SIGTERM) 05:52:10.588241 run iperf3-srv_10.42.42.10(pid=14366): Terminating (SIGTERM) 05:52:10.628280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14369): Terminating (SIGTERM) 05:52:10.668362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14372): Terminating (SIGTERM) 05:52:10.708601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14375): Terminating (SIGTERM) 05:52:10.748753 --- ParallelTerminationStrategy: PID 14363 died... 05:52:10.768492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14363): Terminated: ok {rc=0} 05:52:10.813003 --- ParallelTerminationStrategy: PID 14364 died... 05:52:10.831888 run iperf3-srv_10.42.42.10(pid=14364): Terminated {rc=256} 05:52:10.876133 --- ParallelTerminationStrategy: PID 14365 died... 05:52:10.895132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14365): Terminated: ok {rc=0} 05:52:10.939478 --- ParallelTerminationStrategy: PID 14366 died... 05:52:10.958502 run iperf3-srv_10.42.42.10(pid=14366): Terminated {rc=256} 05:52:11.002612 --- ParallelTerminationStrategy: PID 14369 died... 05:52:11.022021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14369): Terminated: ok {rc=0} 05:52:11.066351 --- ParallelTerminationStrategy: PID 14372 died... 05:52:11.085492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14372): Terminated: ok {rc=0} 05:52:11.129764 --- ParallelTerminationStrategy: PID 14375 died... 05:52:11.148816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14375): Terminated: ok {rc=0} 05:52:11.232747 bus /gobi_0: Setting Powered False 05:52:12.329387 bus /gobi_0: Setting Powered False 05:52:13.443440 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:52:14.593296 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:14.604794 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:14.657389 tst iperf3.py: using LAC 38849 05:52:14.782596 tst iperf3.py: using RAC 89 05:52:14.907245 tst iperf3.py: using CellId 38849 05:52:15.031813 tst iperf3.py: using BVCI 38850 05:52:15.147614 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.158592 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.169249 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.179821 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.190659 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.202383 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.213774 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.224787 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.236104 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:15.352076 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:52:15.565434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:15.886293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14377): Launched 05:52:16.205778 run iperf3-srv_10.42.42.10(pid=14378): Launched 05:52:16.346918 tst iperf3.py:8: start network... 05:52:16.581490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:17.117762 run create_hlr_db(pid=14379): Launched 05:52:17.270436 bus /gobi_6: Setting Powered False 05:52:18.336400 run create_hlr_db(pid=14379): Terminated: ok {rc=0} 05:52:18.783644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14381): Launched 05:52:19.098578 run osmo-hlr_10.42.42.2(pid=14382): Launched 05:52:19.218918 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:19.772918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14384): Launched 05:52:20.086895 run osmo-stp_10.42.42.5(pid=14385): Launched 05:52:20.206789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:20.747890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14387): Launched 05:52:20.868694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:21.134405 run patchelf(pid=14388): Launched 05:52:21.308608 run osmo-stp_10.42.42.5(pid=14385): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14385)] 05:52:21.441990 run osmo-stp_10.42.42.5(pid=14385): stdout: | (launched: 2022-12-14_05:52:20.029646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:21.577733 run osmo-stp_10.42.42.5(pid=14385): stderr: | 20221214055220202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055220202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055220202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055220203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055220203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055220203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055220203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:21.712829 run osmo-stp_10.42.42.5(pid=14385): stdout: | (launched: 2022-12-14_05:52:20.029646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:21.841995 run osmo-stp_10.42.42.5(pid=14385): stderr: | 20221214055220202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055220202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055220202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055220203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055220203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055220203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055220203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:21.994745 run patchelf(pid=14388): Terminating (SIGINT) 05:52:22.171132 run patchelf(pid=14388): Terminated: ok {rc=0} 05:52:22.298423 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14385): Process ended prematurely: osmo-stp_10.42.42.5(pid=14385) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14385)] [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 05:52:22.308082 tst iperf3.py:8: Test FAILED (7.8 sec) 05:52:22.335479 run osmo-hlr_10.42.42.2(pid=14382): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14382)] 05:52:22.384153 run osmo-hlr_10.42.42.2(pid=14382): stdout: | (launched: 2022-12-14_05:52:19.041323) 05:52:22.434388 run osmo-hlr_10.42.42.2(pid=14382): stderr: | 20221214055219217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055219217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055219217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055219217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055219217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055219217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055219230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055219238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055219238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055219238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:22.485061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14377): Terminating (SIGTERM) 05:52:22.525754 run iperf3-srv_10.42.42.10(pid=14378): Terminating (SIGTERM) 05:52:22.566227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14381): Terminating (SIGTERM) 05:52:22.606841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14384): Terminating (SIGTERM) 05:52:22.647377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14387): Terminating (SIGTERM) 05:52:22.688217 --- ParallelTerminationStrategy: PID 14377 died... 05:52:22.708077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14377): Terminated: ok {rc=0} 05:52:22.753149 --- ParallelTerminationStrategy: PID 14378 died... 05:52:22.772309 run iperf3-srv_10.42.42.10(pid=14378): Terminated {rc=256} 05:52:22.817192 --- ParallelTerminationStrategy: PID 14381 died... 05:52:22.836528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14381): Terminated: ok {rc=0} 05:52:22.881231 --- ParallelTerminationStrategy: PID 14384 died... 05:52:22.900361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14384): Terminated: ok {rc=0} 05:52:22.945143 --- ParallelTerminationStrategy: PID 14387 died... 05:52:22.964313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14387): Terminated: ok {rc=0} 05:52:23.052227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:52:24.206396 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.218625 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:24.272479 tst iperf3m4.py: using LAC 38850 05:52:24.404040 tst iperf3m4.py: using RAC 90 05:52:24.536479 tst iperf3m4.py: using CellId 38850 05:52:24.667480 tst iperf3m4.py: using BVCI 38851 05:52:24.791000 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.802486 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.813706 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.824706 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.836106 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.847602 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.859218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.870366 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:24.881868 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:25.005018 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:25.129765 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:25.252737 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:25.370427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:52:25.584248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:25.902029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14389): Launched 05:52:26.177700 run iperf3-srv_10.42.42.10(pid=14390): Launched 05:52:26.295062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:52:26.505447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:26.821056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14391): Launched 05:52:27.094543 run iperf3-srv_10.42.42.10(pid=14392): Launched 05:52:27.214388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:52:27.425109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:27.742085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14393): Launched 05:52:28.018271 run iperf3-srv_10.42.42.10(pid=14394): Launched 05:52:28.138088 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:52:28.349160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:28.665715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14395): Launched 05:52:28.940013 run iperf3-srv_10.42.42.10(pid=14396): Launched 05:52:29.057490 tst iperf3m4.py:8: start network... 05:52:29.268212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:29.757035 run create_hlr_db(pid=14397): Launched 05:52:29.876880 bus /gobi_6: Setting Powered False 05:52:30.949214 run create_hlr_db(pid=14397): Terminated: ok {rc=0} 05:52:31.438440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14399): Launched 05:52:31.794264 run osmo-hlr_10.42.42.2(pid=14400): Launched 05:52:32.032069 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:32.644026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14402): Launched 05:52:32.959190 run osmo-stp_10.42.42.5(pid=14403): Launched 05:52:33.078436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:33.621654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14405): Launched 05:52:33.742854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:34.009519 run patchelf(pid=14406): Launched 05:52:34.184297 run osmo-stp_10.42.42.5(pid=14403): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14403)] 05:52:34.317371 run osmo-stp_10.42.42.5(pid=14403): stdout: | (launched: 2022-12-14_05:52:32.901577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:34.452097 run osmo-stp_10.42.42.5(pid=14403): stderr: | 20221214055233071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055233071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055233071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055233072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055233072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055233072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055233072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:34.586701 run osmo-stp_10.42.42.5(pid=14403): stdout: | (launched: 2022-12-14_05:52:32.901577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:34.715261 run osmo-stp_10.42.42.5(pid=14403): stderr: | 20221214055233071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055233071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055233071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055233072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055233072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055233072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055233072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:34.867345 run patchelf(pid=14406): Terminating (SIGINT) 05:52:35.043126 run patchelf(pid=14406): Terminated: ok {rc=0} 05:52:35.170304 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14403): Process ended prematurely: osmo-stp_10.42.42.5(pid=14403) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14403)] [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 05:52:35.180001 tst iperf3m4.py:8: Test FAILED (11.0 sec) 05:52:35.207645 run osmo-hlr_10.42.42.2(pid=14400): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14400)] 05:52:35.256277 run osmo-hlr_10.42.42.2(pid=14400): stdout: | (launched: 2022-12-14_05:52:31.731462) 05:52:35.306220 run osmo-hlr_10.42.42.2(pid=14400): stderr: | 20221214055231979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055231979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055231980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055231980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055231980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055231980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055232005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055232027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055232029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055232029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:35.356497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14389): Terminating (SIGTERM) 05:52:35.397048 run iperf3-srv_10.42.42.10(pid=14390): Terminating (SIGTERM) 05:52:35.437449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14391): Terminating (SIGTERM) 05:52:35.478057 run iperf3-srv_10.42.42.10(pid=14392): Terminating (SIGTERM) 05:52:35.518354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14393): Terminating (SIGTERM) 05:52:35.559379 run iperf3-srv_10.42.42.10(pid=14394): Terminating (SIGTERM) 05:52:35.599818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14395): Terminating (SIGTERM) 05:52:35.640198 run iperf3-srv_10.42.42.10(pid=14396): Terminating (SIGTERM) 05:52:35.680397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14399): Terminating (SIGTERM) 05:52:35.720686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14402): Terminating (SIGTERM) 05:52:35.760987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14405): Terminating (SIGTERM) 05:52:35.801733 --- ParallelTerminationStrategy: PID 14389 died... 05:52:35.821546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14389): Terminated: ok {rc=0} 05:52:35.866366 --- ParallelTerminationStrategy: PID 14390 died... 05:52:35.885426 run iperf3-srv_10.42.42.10(pid=14390): Terminated {rc=256} 05:52:35.929882 --- ParallelTerminationStrategy: PID 14391 died... 05:52:35.949147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14391): Terminated: ok {rc=0} 05:52:35.993724 --- ParallelTerminationStrategy: PID 14392 died... 05:52:36.012774 run iperf3-srv_10.42.42.10(pid=14392): Terminated {rc=256} 05:52:36.057366 --- ParallelTerminationStrategy: PID 14393 died... 05:52:36.076336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14393): Terminated: ok {rc=0} 05:52:36.121412 --- ParallelTerminationStrategy: PID 14394 died... 05:52:36.140652 run iperf3-srv_10.42.42.10(pid=14394): Terminated {rc=256} 05:52:36.185425 --- ParallelTerminationStrategy: PID 14395 died... 05:52:36.204686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14395): Terminated: ok {rc=0} 05:52:36.249349 --- ParallelTerminationStrategy: PID 14396 died... 05:52:36.268593 run iperf3-srv_10.42.42.10(pid=14396): Terminated {rc=256} 05:52:36.313300 --- ParallelTerminationStrategy: PID 14399 died... 05:52:36.332701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14399): Terminated: ok {rc=0} 05:52:36.377524 --- ParallelTerminationStrategy: PID 14402 died... 05:52:36.396823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14402): Terminated: ok {rc=0} 05:52:36.441683 --- ParallelTerminationStrategy: PID 14405 died... 05:52:36.461030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14405): Terminated: ok {rc=0} 05:52:36.548305 bus /gobi_4: Setting Powered False 05:52:37.649528 bus /gobi_4: Setting Powered False 05:52:38.767629 bus /gobi_1: Setting Powered False 05:52:39.866873 bus /gobi_1: Setting Powered False 05:52:40.980504 bus /gobi_0: Setting Powered False 05:52:42.081395 bus /gobi_0: Setting Powered False 05:52:43.198998 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 05:52:44.302848 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.314885 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:44.368884 tst ping.py: using LAC 38851 05:52:44.490318 tst ping.py: using RAC 91 05:52:44.614828 tst ping.py: using CellId 38851 05:52:44.737514 tst ping.py: using BVCI 38852 05:52:44.852504 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.863596 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.874356 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.885191 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.896116 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.907538 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.918808 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:44.929923 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:45.049437 tst ping.py:19: start network... 05:52:45.272111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:45.782363 run create_hlr_db(pid=14407): Launched 05:52:45.922970 bus /gobi_6: Setting Powered False 05:52:46.982271 run create_hlr_db(pid=14407): Terminated: ok {rc=0} 05:52:47.441751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14409): Launched 05:52:47.751304 run osmo-hlr_10.42.42.2(pid=14410): Launched 05:52:47.869275 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:48.417801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14412): Launched 05:52:48.725835 run osmo-stp_10.42.42.5(pid=14413): Launched 05:52:48.843266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:49.374850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14415): Launched 05:52:49.494888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:49.756553 run patchelf(pid=14416): Launched 05:52:49.928515 run osmo-stp_10.42.42.5(pid=14413): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14413)] 05:52:50.059155 run osmo-stp_10.42.42.5(pid=14413): stdout: | (launched: 2022-12-14_05:52:48.669301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:50.191874 run osmo-stp_10.42.42.5(pid=14413): stderr: | 20221214055248840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055248840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055248840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055248841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055248841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055248841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055248841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:50.324526 run osmo-stp_10.42.42.5(pid=14413): stdout: | (launched: 2022-12-14_05:52:48.669301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:50.451036 run osmo-stp_10.42.42.5(pid=14413): stderr: | 20221214055248840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055248840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055248840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055248841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055248841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055248841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055248841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:50.601323 run patchelf(pid=14416): Terminating (SIGINT) 05:52:50.773602 run patchelf(pid=14416): Terminated: ok {rc=0} 05:52:50.898016 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14413): Process ended prematurely: osmo-stp_10.42.42.5(pid=14413) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14413)] [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 05:52:50.907182 tst ping.py:22: Test FAILED (6.6 sec) 05:52:50.934304 run osmo-hlr_10.42.42.2(pid=14410): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14410)] 05:52:50.983223 run osmo-hlr_10.42.42.2(pid=14410): stdout: | (launched: 2022-12-14_05:52:47.694675) 05:52:51.033424 run osmo-hlr_10.42.42.2(pid=14410): stderr: | 20221214055247869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055247869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055247869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055247869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055247869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055247870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055247881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055247889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055247890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055247890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:51.084008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14409): Terminating (SIGTERM) 05:52:51.125188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14412): Terminating (SIGTERM) 05:52:51.165639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14415): Terminating (SIGTERM) 05:52:51.206467 --- ParallelTerminationStrategy: PID 14409 died... 05:52:51.226272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14409): Terminated: ok {rc=0} 05:52:51.271079 --- ParallelTerminationStrategy: PID 14412 died... 05:52:51.290295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14412): Terminated: ok {rc=0} 05:52:51.335092 --- ParallelTerminationStrategy: PID 14415 died... 05:52:51.354280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14415): Terminated: ok {rc=0} 05:52:51.441408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:52:52.530087 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:52.542737 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:52.601321 tst ping_idle_ping.py: using LAC 38852 05:52:52.729719 tst ping_idle_ping.py: using RAC 92 05:52:52.852095 tst ping_idle_ping.py: using CellId 38852 05:52:52.972085 tst ping_idle_ping.py: using BVCI 38853 05:52:53.084515 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.095511 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.106287 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.116915 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.127997 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.139063 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.150195 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:53.161201 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:53.280630 tst ping_idle_ping.py:24: start network... 05:52:53.503309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:54.016870 run create_hlr_db(pid=14417): Launched 05:52:54.150316 bus /gobi_6: Setting Powered False 05:52:55.215760 run create_hlr_db(pid=14417): Terminated: ok {rc=0} 05:52:55.658358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14419): Launched 05:52:55.969026 run osmo-hlr_10.42.42.2(pid=14420): Launched 05:52:56.087362 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:56.633369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14422): Launched 05:52:56.942982 run osmo-stp_10.42.42.5(pid=14423): Launched 05:52:57.061694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:57.597726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14425): Launched 05:52:57.716442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:57.979055 run patchelf(pid=14426): Launched 05:52:58.150958 run osmo-stp_10.42.42.5(pid=14423): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14423)] 05:52:58.282400 run osmo-stp_10.42.42.5(pid=14423): stdout: | (launched: 2022-12-14_05:52:56.886024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:58.415222 run osmo-stp_10.42.42.5(pid=14423): stderr: | 20221214055257060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055257060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055257060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055257060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055257061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055257061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055257061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:58.548933 run osmo-stp_10.42.42.5(pid=14423): stdout: | (launched: 2022-12-14_05:52:56.886024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:58.675653 run osmo-stp_10.42.42.5(pid=14423): stderr: | 20221214055257060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055257060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055257060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055257060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055257061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055257061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055257061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:58.825794 run patchelf(pid=14426): Terminating (SIGINT) 05:52:58.999931 run patchelf(pid=14426): Terminated: ok {rc=0} 05:52:59.125628 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14423): Process ended prematurely: osmo-stp_10.42.42.5(pid=14423) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14423)] [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 05:52:59.134662 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:52:59.161672 run osmo-hlr_10.42.42.2(pid=14420): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14420)] 05:52:59.210057 run osmo-hlr_10.42.42.2(pid=14420): stdout: | (launched: 2022-12-14_05:52:55.912202) 05:52:59.259802 run osmo-hlr_10.42.42.2(pid=14420): stderr: | 20221214055256087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055256087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055256087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055256087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055256088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055256088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055256100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055256108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055256108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055256108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:59.309958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14419): Terminating (SIGTERM) 05:52:59.350354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14422): Terminating (SIGTERM) 05:52:59.390849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14425): Terminating (SIGTERM) 05:52:59.431825 --- ParallelTerminationStrategy: PID 14419 died... 05:52:59.451643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14419): Terminated: ok {rc=0} 05:52:59.496767 --- ParallelTerminationStrategy: PID 14422 died... 05:52:59.516091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14422): Terminated: ok {rc=0} 05:52:59.560906 --- ParallelTerminationStrategy: PID 14425 died... 05:52:59.580273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14425): Terminated: ok {rc=0} 05:52:59.665240 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:53:01.011771 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:53:01.021830 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:53:01.058895 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:53:01.100311 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:53:01.191122 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:53:01.225571 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:53:01.272248 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:53:01.855059 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:53:01.909810 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:01.921677 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:01.993681 tst cs_paging_gprs_active.py: using LAC 38853 05:53:02.122481 tst cs_paging_gprs_active.py: using RAC 93 05:53:02.266868 tst cs_paging_gprs_active.py: using CellId 38853 05:53:02.398964 tst cs_paging_gprs_active.py: using BVCI 38854 05:53:02.523010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.534683 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.546183 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.557578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.569724 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.581815 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.593798 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.605603 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:02.617634 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:02.737963 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:02.859599 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:53:03.087249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:03.423514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14431): Launched 05:53:03.715889 run iperf3-srv_10.42.42.10(pid=14432): Launched 05:53:03.842799 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:53:04.069814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:04.406544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14433): Launched 05:53:04.698389 run iperf3-srv_10.42.42.10(pid=14434): Launched 05:53:04.823676 tst cs_paging_gprs_active.py:38: start network... 05:53:05.049685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:05.568910 run create_hlr_db(pid=14435): Launched 05:53:05.706046 bus /gobi_6: Setting Powered False 05:53:06.771447 run create_hlr_db(pid=14435): Terminated: ok {rc=0} 05:53:07.218078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14437): Launched 05:53:07.532698 run osmo-hlr_10.42.42.2(pid=14438): Launched 05:53:07.654156 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:08.206496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14440): Launched 05:53:08.521074 run osmo-stp_10.42.42.5(pid=14441): Launched 05:53:08.642470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:09.185598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14443): Launched 05:53:09.306086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:09.571990 run patchelf(pid=14444): Launched 05:53:09.747335 run osmo-stp_10.42.42.5(pid=14441): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14441)] 05:53:09.881363 run osmo-stp_10.42.42.5(pid=14441): stdout: | (launched: 2022-12-14_05:53:08.463548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:10.017135 run osmo-stp_10.42.42.5(pid=14441): stderr: | 20221214055308635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055308635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055308636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055308636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055308637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055308637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055308637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:10.152253 run osmo-stp_10.42.42.5(pid=14441): stdout: | (launched: 2022-12-14_05:53:08.463548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:10.281398 run osmo-stp_10.42.42.5(pid=14441): stderr: | 20221214055308635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055308635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055308636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055308636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055308637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055308637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055308637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:10.433914 run patchelf(pid=14444): Terminating (SIGINT) 05:53:10.610528 run patchelf(pid=14444): Terminated: ok {rc=0} 05:53:10.738038 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14441): Process ended prematurely: osmo-stp_10.42.42.5(pid=14441) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14441)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:53:10.747631 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:53:10.774713 run osmo-hlr_10.42.42.2(pid=14438): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14438)] 05:53:10.822860 run osmo-hlr_10.42.42.2(pid=14438): stdout: | (launched: 2022-12-14_05:53:07.475172) 05:53:10.872694 run osmo-hlr_10.42.42.2(pid=14438): stderr: | 20221214055307652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055307652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055307652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055307652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055307652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055307652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055307665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055307673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055307673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055307673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:10.922820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14431): Terminating (SIGTERM) 05:53:10.963407 run iperf3-srv_10.42.42.10(pid=14432): Terminating (SIGTERM) 05:53:11.003614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14433): Terminating (SIGTERM) 05:53:11.043967 run iperf3-srv_10.42.42.10(pid=14434): Terminating (SIGTERM) 05:53:11.084108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14437): Terminating (SIGTERM) 05:53:11.124442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14440): Terminating (SIGTERM) 05:53:11.164683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14443): Terminating (SIGTERM) 05:53:11.205207 --- ParallelTerminationStrategy: PID 14431 died... 05:53:11.224847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14431): Terminated: ok {rc=0} 05:53:11.269243 --- ParallelTerminationStrategy: PID 14432 died... 05:53:11.288169 run iperf3-srv_10.42.42.10(pid=14432): Terminated {rc=256} 05:53:11.332376 --- ParallelTerminationStrategy: PID 14433 died... 05:53:11.351510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14433): Terminated: ok {rc=0} 05:53:11.395579 --- ParallelTerminationStrategy: PID 14434 died... 05:53:11.414505 run iperf3-srv_10.42.42.10(pid=14434): Terminated {rc=256} 05:53:11.458565 --- ParallelTerminationStrategy: PID 14437 died... 05:53:11.477380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14437): Terminated: ok {rc=0} 05:53:11.521401 --- ParallelTerminationStrategy: PID 14440 died... 05:53:11.540380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14440): Terminated: ok {rc=0} 05:53:11.585098 --- ParallelTerminationStrategy: PID 14443 died... 05:53:11.604053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14443): Terminated: ok {rc=0} 05:53:11.690813 bus /gobi_0: Setting Powered False 05:53:12.792133 bus /gobi_0: Setting Powered False 05:53:13.908442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:53:15.059048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.071201 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:15.146232 tst iperf3.py: using LAC 38854 05:53:15.277879 tst iperf3.py: using RAC 94 05:53:15.408382 tst iperf3.py: using CellId 38854 05:53:15.539726 tst iperf3.py: using BVCI 38855 05:53:15.663006 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.674529 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.685825 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.697131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.708232 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.719477 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.730800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.741946 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:15.753316 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:15.896100 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:53:16.116765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:16.444781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14445): Launched 05:53:16.753802 run iperf3-srv_10.42.42.10(pid=14446): Launched 05:53:16.877956 tst iperf3.py:8: start network... 05:53:17.098296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:17.595214 run create_hlr_db(pid=14447): Launched 05:53:17.718267 bus /gobi_6: Setting Powered False 05:53:18.780240 run create_hlr_db(pid=14447): Terminated: ok {rc=0} 05:53:19.238412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14449): Launched 05:53:19.573917 run osmo-hlr_10.42.42.2(pid=14450): Launched 05:53:19.701420 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:20.285162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14452): Launched 05:53:20.620220 run osmo-stp_10.42.42.5(pid=14453): Launched 05:53:20.748411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:21.328051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14455): Launched 05:53:21.456275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:21.740695 run patchelf(pid=14456): Launched 05:53:21.926907 run osmo-stp_10.42.42.5(pid=14453): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14453)] 05:53:22.069148 run osmo-stp_10.42.42.5(pid=14453): stdout: | (launched: 2022-12-14_05:53:20.559141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:22.212586 run osmo-stp_10.42.42.5(pid=14453): stderr: | 20221214055320752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055320752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055320753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055320753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055320754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055320754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055320754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:22.355947 run osmo-stp_10.42.42.5(pid=14453): stdout: | (launched: 2022-12-14_05:53:20.559141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:22.492872 run osmo-stp_10.42.42.5(pid=14453): stderr: | 20221214055320752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055320752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055320753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055320753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055320754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055320754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055320754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:22.655804 run patchelf(pid=14456): Terminating (SIGINT) 05:53:22.843171 run patchelf(pid=14456): Terminated: ok {rc=0} 05:53:22.977743 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14453): Process ended prematurely: osmo-stp_10.42.42.5(pid=14453) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14453)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 05:53:22.988201 tst iperf3.py:8: Test FAILED (8.0 sec) 05:53:23.017057 run osmo-hlr_10.42.42.2(pid=14450): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14450)] 05:53:23.067371 run osmo-hlr_10.42.42.2(pid=14450): stdout: | (launched: 2022-12-14_05:53:19.512627) 05:53:23.119638 run osmo-hlr_10.42.42.2(pid=14450): stderr: | 20221214055319713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055319713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055319714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055319714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055319714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055319714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055319726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055319735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055319735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055319735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:23.172390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14445): Terminating (SIGTERM) 05:53:23.214952 run iperf3-srv_10.42.42.10(pid=14446): Terminating (SIGTERM) 05:53:23.258234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14449): Terminating (SIGTERM) 05:53:23.301052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14452): Terminating (SIGTERM) 05:53:23.343845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14455): Terminating (SIGTERM) 05:53:23.386946 --- ParallelTerminationStrategy: PID 14445 died... 05:53:23.407415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14445): Terminated: ok {rc=0} 05:53:23.454595 --- ParallelTerminationStrategy: PID 14446 died... 05:53:23.474527 run iperf3-srv_10.42.42.10(pid=14446): Terminated {rc=256} 05:53:23.521618 --- ParallelTerminationStrategy: PID 14449 died... 05:53:23.541959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14449): Terminated: ok {rc=0} 05:53:23.589088 --- ParallelTerminationStrategy: PID 14452 died... 05:53:23.609089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14452): Terminated: ok {rc=0} 05:53:23.656044 --- ParallelTerminationStrategy: PID 14455 died... 05:53:23.675955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14455): Terminated: ok {rc=0} 05:53:23.765472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:53:24.913952 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:24.925793 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:24.995142 tst iperf3m4.py: using LAC 38855 05:53:25.118894 tst iperf3m4.py: using RAC 95 05:53:25.248251 tst iperf3m4.py: using CellId 38855 05:53:25.371790 tst iperf3m4.py: using BVCI 38856 05:53:25.487570 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.498705 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.509504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.520189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.531219 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.542275 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.553538 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.564521 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.575598 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:25.695853 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:25.816673 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:25.939140 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:26.058008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:53:26.271025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:26.588583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14458): Launched 05:53:26.863647 run iperf3-srv_10.42.42.10(pid=14459): Launched 05:53:26.982634 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:53:27.195047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:27.512481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14460): Launched 05:53:27.787007 run iperf3-srv_10.42.42.10(pid=14461): Launched 05:53:27.916600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:53:28.143690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:28.480718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14462): Launched 05:53:28.773406 run iperf3-srv_10.42.42.10(pid=14463): Launched 05:53:28.898427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:53:29.124070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:29.460280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14464): Launched 05:53:29.752098 run iperf3-srv_10.42.42.10(pid=14465): Launched 05:53:29.877344 tst iperf3m4.py:8: start network... 05:53:30.103838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:30.623463 run create_hlr_db(pid=14466): Launched 05:53:30.758805 bus /gobi_6: Setting Powered False 05:53:31.851470 run create_hlr_db(pid=14466): Terminated: ok {rc=0} 05:53:32.327310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14468): Launched 05:53:32.665113 run osmo-hlr_10.42.42.2(pid=14469): Launched 05:53:32.792389 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:33.373976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14471): Launched 05:53:33.710692 run osmo-stp_10.42.42.5(pid=14472): Launched 05:53:33.838586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:34.418388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14474): Launched 05:53:34.547290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:34.831440 run patchelf(pid=14475): Launched 05:53:35.018640 run osmo-stp_10.42.42.5(pid=14472): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14472)] 05:53:35.160327 run osmo-stp_10.42.42.5(pid=14472): stdout: | (launched: 2022-12-14_05:53:33.649737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:35.303737 run osmo-stp_10.42.42.5(pid=14472): stderr: | 20221214055333840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055333840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055333840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055333841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055333841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055333841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055333841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:35.446855 run osmo-stp_10.42.42.5(pid=14472): stdout: | (launched: 2022-12-14_05:53:33.649737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:35.584161 run osmo-stp_10.42.42.5(pid=14472): stderr: | 20221214055333840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055333840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055333840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055333841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055333841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055333841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055333841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:35.746181 run patchelf(pid=14475): Terminating (SIGINT) 05:53:35.933746 run patchelf(pid=14475): Terminated: ok {rc=0} 05:53:36.069939 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14472): Process ended prematurely: osmo-stp_10.42.42.5(pid=14472) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14472)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:53:36.080231 tst iperf3m4.py:8: Test FAILED (11.2 sec) 05:53:36.109503 run osmo-hlr_10.42.42.2(pid=14469): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14469)] 05:53:36.159918 run osmo-hlr_10.42.42.2(pid=14469): stdout: | (launched: 2022-12-14_05:53:32.603905) 05:53:36.211963 run osmo-hlr_10.42.42.2(pid=14469): stderr: | 20221214055332802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055332802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055332802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055332802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055332802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055332802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055332814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055332823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055332823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055332823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:36.264229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14458): Terminating (SIGTERM) 05:53:36.306597 run iperf3-srv_10.42.42.10(pid=14459): Terminating (SIGTERM) 05:53:36.349018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14460): Terminating (SIGTERM) 05:53:36.391260 run iperf3-srv_10.42.42.10(pid=14461): Terminating (SIGTERM) 05:53:36.433932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14462): Terminating (SIGTERM) 05:53:36.476256 run iperf3-srv_10.42.42.10(pid=14463): Terminating (SIGTERM) 05:53:36.519002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14464): Terminating (SIGTERM) 05:53:36.561999 run iperf3-srv_10.42.42.10(pid=14465): Terminating (SIGTERM) 05:53:36.604228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14468): Terminating (SIGTERM) 05:53:36.646548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14471): Terminating (SIGTERM) 05:53:36.689154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14474): Terminating (SIGTERM) 05:53:36.731555 --- ParallelTerminationStrategy: PID 14458 died... 05:53:36.751789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14458): Terminated: ok {rc=0} 05:53:36.798423 --- ParallelTerminationStrategy: PID 14459 died... 05:53:36.818153 run iperf3-srv_10.42.42.10(pid=14459): Terminated {rc=256} 05:53:36.864213 --- ParallelTerminationStrategy: PID 14460 died... 05:53:36.883903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14460): Terminated: ok {rc=0} 05:53:36.930762 --- ParallelTerminationStrategy: PID 14461 died... 05:53:36.950699 run iperf3-srv_10.42.42.10(pid=14461): Terminated {rc=256} 05:53:36.997273 --- ParallelTerminationStrategy: PID 14462 died... 05:53:37.017158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14462): Terminated: ok {rc=0} 05:53:37.063592 --- ParallelTerminationStrategy: PID 14463 died... 05:53:37.083315 run iperf3-srv_10.42.42.10(pid=14463): Terminated {rc=256} 05:53:37.129681 --- ParallelTerminationStrategy: PID 14464 died... 05:53:37.149334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14464): Terminated: ok {rc=0} 05:53:37.195474 --- ParallelTerminationStrategy: PID 14465 died... 05:53:37.215062 run iperf3-srv_10.42.42.10(pid=14465): Terminated {rc=256} 05:53:37.261059 --- ParallelTerminationStrategy: PID 14468 died... 05:53:37.280599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14468): Terminated: ok {rc=0} 05:53:37.326829 --- ParallelTerminationStrategy: PID 14471 died... 05:53:37.346635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14471): Terminated: ok {rc=0} 05:53:37.392860 --- ParallelTerminationStrategy: PID 14474 died... 05:53:37.412604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14474): Terminated: ok {rc=0} 05:53:37.500207 bus /gobi_4: Setting Powered False 05:53:38.600037 bus /gobi_4: Setting Powered False 05:53:39.716276 bus /gobi_1: Setting Powered False 05:53:40.815119 bus /gobi_1: Setting Powered False 05:53:41.930599 bus /gobi_0: Setting Powered False 05:53:43.028429 bus /gobi_0: Setting Powered False 05:53:44.147138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:53:45.250122 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.261989 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:45.331772 tst ping.py: using LAC 38856 05:53:45.452910 tst ping.py: using RAC 96 05:53:45.573830 tst ping.py: using CellId 38856 05:53:45.697197 tst ping.py: using BVCI 38857 05:53:45.811073 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.822213 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.841765 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.855595 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.876349 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.892206 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.920924 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:45.933600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:46.075032 tst ping.py:19: start network... 05:53:46.327078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:46.815678 run create_hlr_db(pid=14476): Launched 05:53:46.982724 bus /gobi_6: Setting Powered False 05:53:48.047376 run create_hlr_db(pid=14476): Terminated: ok {rc=0} 05:53:48.496909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14478): Launched 05:53:48.806139 run osmo-hlr_10.42.42.2(pid=14479): Launched 05:53:48.926021 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:49.479446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14481): Launched 05:53:49.786880 run osmo-stp_10.42.42.5(pid=14482): Launched 05:53:49.904364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:50.437788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14484): Launched 05:53:50.555976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:50.817158 run patchelf(pid=14485): Launched 05:53:50.988572 run osmo-stp_10.42.42.5(pid=14482): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14482)] 05:53:51.119511 run osmo-stp_10.42.42.5(pid=14482): stdout: | (launched: 2022-12-14_05:53:49.730404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:51.252616 run osmo-stp_10.42.42.5(pid=14482): stderr: | 20221214055349902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055349902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055349903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055349903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055349903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055349903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055349904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:51.385400 run osmo-stp_10.42.42.5(pid=14482): stdout: | (launched: 2022-12-14_05:53:49.730404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:51.511720 run osmo-stp_10.42.42.5(pid=14482): stderr: | 20221214055349902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055349902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055349903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055349903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055349903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055349903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055349904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:51.661492 run patchelf(pid=14485): Terminating (SIGINT) 05:53:51.834892 run patchelf(pid=14485): Terminated: ok {rc=0} 05:53:51.959977 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14482): Process ended prematurely: osmo-stp_10.42.42.5(pid=14482) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14482)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 05:53:51.969151 tst ping.py:22: Test FAILED (6.7 sec) 05:53:51.996089 run osmo-hlr_10.42.42.2(pid=14479): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14479)] 05:53:52.044465 run osmo-hlr_10.42.42.2(pid=14479): stdout: | (launched: 2022-12-14_05:53:48.749338) 05:53:52.094081 run osmo-hlr_10.42.42.2(pid=14479): stderr: | 20221214055348925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055348925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055348925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055348925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055348925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055348925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055348936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055348944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055348945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055348945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:52.144311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14478): Terminating (SIGTERM) 05:53:52.185005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14481): Terminating (SIGTERM) 05:53:52.225408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14484): Terminating (SIGTERM) 05:53:52.265794 --- ParallelTerminationStrategy: PID 14478 died... 05:53:52.285241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14478): Terminated: ok {rc=0} 05:53:52.329573 --- ParallelTerminationStrategy: PID 14481 died... 05:53:52.348711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14481): Terminated: ok {rc=0} 05:53:52.392807 --- ParallelTerminationStrategy: PID 14484 died... 05:53:52.412254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14484): Terminated: ok {rc=0} 05:53:52.498707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:53:53.586732 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:53.598323 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:53.668636 tst ping_idle_ping.py: using LAC 38857 05:53:53.790541 tst ping_idle_ping.py: using RAC 97 05:53:53.914528 tst ping_idle_ping.py: using CellId 38857 05:53:54.037374 tst ping_idle_ping.py: using BVCI 38858 05:53:54.150326 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.161398 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.172066 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.182859 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.194259 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.205501 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.216574 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:54.227698 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:54.347979 tst ping_idle_ping.py:24: start network... 05:53:54.573778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:55.094404 run create_hlr_db(pid=14486): Launched 05:53:55.230049 bus /gobi_6: Setting Powered False 05:53:56.294854 run create_hlr_db(pid=14486): Terminated: ok {rc=0} 05:53:56.754139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14488): Launched 05:53:57.085994 run osmo-hlr_10.42.42.2(pid=14489): Launched 05:53:57.214705 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:57.786818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14491): Launched 05:53:58.101286 run osmo-stp_10.42.42.5(pid=14492): Launched 05:53:58.219762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:58.754376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14494): Launched 05:53:58.873348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:59.135623 run patchelf(pid=14495): Launched 05:53:59.307886 run osmo-stp_10.42.42.5(pid=14492): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14492)] 05:53:59.439096 run osmo-stp_10.42.42.5(pid=14492): stdout: | (launched: 2022-12-14_05:53:58.044023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:59.571931 run osmo-stp_10.42.42.5(pid=14492): stderr: | 20221214055358216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055358216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055358216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055358217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055358217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055358218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055358218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:59.704376 run osmo-stp_10.42.42.5(pid=14492): stdout: | (launched: 2022-12-14_05:53:58.044023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:59.830911 run osmo-stp_10.42.42.5(pid=14492): stderr: | 20221214055358216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055358216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055358216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055358217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055358217 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055358218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055358218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:59.980720 run patchelf(pid=14495): Terminating (SIGINT) 05:54:00.153924 run patchelf(pid=14495): Terminated: ok {rc=0} 05:54:00.279485 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14492): Process ended prematurely: osmo-stp_10.42.42.5(pid=14492) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14492)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:54:00.288616 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 05:54:00.315422 run osmo-hlr_10.42.42.2(pid=14489): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14489)] 05:54:00.363794 run osmo-hlr_10.42.42.2(pid=14489): stdout: | (launched: 2022-12-14_05:53:57.025567) 05:54:00.413721 run osmo-hlr_10.42.42.2(pid=14489): stderr: | 20221214055357223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055357223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055357223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055357223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055357223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055357223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055357235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055357244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055357244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055357244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:00.464068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14488): Terminating (SIGTERM) 05:54:00.504533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14491): Terminating (SIGTERM) 05:54:00.545034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14494): Terminating (SIGTERM) 05:54:00.586214 --- ParallelTerminationStrategy: PID 14488 died... 05:54:00.605828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14488): Terminated: ok {rc=0} 05:54:00.650556 --- ParallelTerminationStrategy: PID 14491 died... 05:54:00.669680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14491): Terminated: ok {rc=0} 05:54:00.714175 --- ParallelTerminationStrategy: PID 14494 died... 05:54:00.733274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14494): Terminated: ok {rc=0} 05:54:00.820263 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:54:02.184332 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:54:02.194130 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:54:02.235224 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:54:02.284277 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:54:02.382380 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:54:02.421406 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:54:02.471307 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:54:03.119757 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:54:03.183807 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.203667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:03.292177 tst cs_paging_gprs_active.py: using LAC 38858 05:54:03.451343 tst cs_paging_gprs_active.py: using RAC 98 05:54:03.613373 tst cs_paging_gprs_active.py: using CellId 38858 05:54:03.755796 tst cs_paging_gprs_active.py: using BVCI 38859 05:54:03.912540 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.924756 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.936715 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.948617 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.961367 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.973896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.986570 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:03.999059 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:04.011700 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:04.139488 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:04.263097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:54:04.494955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:04.842373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14769): Launched 05:54:05.151461 run iperf3-srv_10.42.42.10(pid=14770): Launched 05:54:05.293987 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:54:05.526830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:05.873378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Launched 05:54:06.168833 run iperf3-srv_10.42.42.10(pid=14773): Launched 05:54:06.305641 tst cs_paging_gprs_active.py:38: start network... 05:54:06.521881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:07.026519 run create_hlr_db(pid=14775): Launched 05:54:07.183397 bus /gobi_6: Setting Powered False 05:54:08.247597 run create_hlr_db(pid=14775): Terminated: ok {rc=0} 05:54:08.723584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Launched 05:54:09.074205 run osmo-hlr_10.42.42.2(pid=14778): Launched 05:54:09.328250 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:10.007990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Launched 05:54:10.359307 run osmo-stp_10.42.42.5(pid=14781): Launched 05:54:10.618088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:11.271460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Launched 05:54:11.413748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:11.703351 run patchelf(pid=14784): Launched 05:54:11.904930 run osmo-stp_10.42.42.5(pid=14781): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] 05:54:12.049928 run osmo-stp_10.42.42.5(pid=14781): stdout: | (launched: 2022-12-14_05:54:10.297225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:12.196697 run osmo-stp_10.42.42.5(pid=14781): stderr: | 20221214055410593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055410593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055410593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055410594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055410594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055410594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055410595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:12.343958 run osmo-stp_10.42.42.5(pid=14781): stdout: | (launched: 2022-12-14_05:54:10.297225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:12.484571 run osmo-stp_10.42.42.5(pid=14781): stderr: | 20221214055410593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055410593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055410593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055410594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055410594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055410594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055410595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:12.651351 run patchelf(pid=14784): Terminating (SIGINT) 05:54:12.842873 run patchelf(pid=14784): Terminated: ok {rc=0} 05:54:12.981744 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14781): Process ended prematurely: osmo-stp_10.42.42.5(pid=14781) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:54:12.993296 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 05:54:13.023340 run osmo-hlr_10.42.42.2(pid=14778): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14778)] 05:54:13.075548 run osmo-hlr_10.42.42.2(pid=14778): stdout: | (launched: 2022-12-14_05:54:09.013123) 05:54:13.129659 run osmo-hlr_10.42.42.2(pid=14778): stderr: | 20221214055409311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055409311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055409311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055409311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055409312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055409312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055409333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055409350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055409350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055409350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:13.183902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14769): Terminating (SIGTERM) 05:54:13.228037 run iperf3-srv_10.42.42.10(pid=14770): Terminating (SIGTERM) 05:54:13.274796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Terminating (SIGTERM) 05:54:13.319161 run iperf3-srv_10.42.42.10(pid=14773): Terminating (SIGTERM) 05:54:13.366824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Terminating (SIGTERM) 05:54:13.411226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Terminating (SIGTERM) 05:54:13.457483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Terminating (SIGTERM) 05:54:13.503225 --- ParallelTerminationStrategy: PID 14769 died... 05:54:13.524584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14769): Terminated: ok {rc=0} 05:54:13.574561 --- ParallelTerminationStrategy: PID 14770 died... 05:54:13.595815 run iperf3-srv_10.42.42.10(pid=14770): Terminated {rc=256} 05:54:13.643694 --- ParallelTerminationStrategy: PID 14771 died... 05:54:13.664839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Terminated: ok {rc=0} 05:54:13.712679 --- ParallelTerminationStrategy: PID 14773 died... 05:54:13.733705 run iperf3-srv_10.42.42.10(pid=14773): Terminated {rc=256} 05:54:13.781549 --- ParallelTerminationStrategy: PID 14777 died... 05:54:13.802615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Terminated: ok {rc=0} 05:54:13.850698 --- ParallelTerminationStrategy: PID 14780 died... 05:54:13.871810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Terminated: ok {rc=0} 05:54:13.919816 --- ParallelTerminationStrategy: PID 14783 died... 05:54:13.940846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Terminated: ok {rc=0} 05:54:14.032025 bus /gobi_0: Setting Powered False 05:54:15.137208 bus /gobi_0: Setting Powered False 05:54:16.284169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:54:17.460196 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:17.473129 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:17.550528 tst iperf3.py: using LAC 38859 05:54:17.677539 tst iperf3.py: using RAC 99 05:54:17.806798 tst iperf3.py: using CellId 38859 05:54:17.933897 tst iperf3.py: using BVCI 38860 05:54:18.053879 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.066035 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.078034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.090266 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.103275 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.116767 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.130028 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.142767 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.156039 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:18.273542 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:54:18.493092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:18.818870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Launched 05:54:19.114831 run iperf3-srv_10.42.42.10(pid=14786): Launched 05:54:19.251730 tst iperf3.py:8: start network... 05:54:19.470915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:19.975322 run create_hlr_db(pid=14787): Launched 05:54:20.139893 bus /gobi_6: Setting Powered False 05:54:21.203371 run create_hlr_db(pid=14787): Terminated: ok {rc=0} 05:54:21.658793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14789): Launched 05:54:21.999926 run osmo-hlr_10.42.42.2(pid=14790): Launched 05:54:22.253498 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:22.976612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14792): Launched 05:54:23.318868 run osmo-stp_10.42.42.5(pid=14793): Launched 05:54:23.567899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:24.271725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14795): Launched 05:54:24.399887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:24.685283 run patchelf(pid=14796): Launched 05:54:24.870546 run osmo-stp_10.42.42.5(pid=14793): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14793)] 05:54:25.012253 run osmo-stp_10.42.42.5(pid=14793): stdout: | (launched: 2022-12-14_05:54:23.259579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:25.155763 run osmo-stp_10.42.42.5(pid=14793): stderr: | 20221214055423584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055423584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055423584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055423585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055423585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055423585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055423585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:25.299067 run osmo-stp_10.42.42.5(pid=14793): stdout: | (launched: 2022-12-14_05:54:23.259579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:25.436188 run osmo-stp_10.42.42.5(pid=14793): stderr: | 20221214055423584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055423584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055423584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055423585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055423585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055423585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055423585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:25.599031 run patchelf(pid=14796): Terminating (SIGINT) 05:54:25.786227 run patchelf(pid=14796): Terminated: ok {rc=0} 05:54:25.921254 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14793): Process ended prematurely: osmo-stp_10.42.42.5(pid=14793) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14793)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 05:54:25.931732 tst iperf3.py:8: Test FAILED (8.5 sec) 05:54:25.960643 run osmo-hlr_10.42.42.2(pid=14790): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14790)] 05:54:26.011198 run osmo-hlr_10.42.42.2(pid=14790): stdout: | (launched: 2022-12-14_05:54:21.939654) 05:54:26.063501 run osmo-hlr_10.42.42.2(pid=14790): stderr: | 20221214055422278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055422278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055422278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055422278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055422278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055422278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055422294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055422307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055422307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055422307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:26.116309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Terminating (SIGTERM) 05:54:26.158774 run iperf3-srv_10.42.42.10(pid=14786): Terminating (SIGTERM) 05:54:26.200925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14789): Terminating (SIGTERM) 05:54:26.243255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14792): Terminating (SIGTERM) 05:54:26.285656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14795): Terminating (SIGTERM) 05:54:26.328790 --- ParallelTerminationStrategy: PID 14785 died... 05:54:26.349121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Terminated: ok {rc=0} 05:54:26.395774 --- ParallelTerminationStrategy: PID 14786 died... 05:54:26.415422 run iperf3-srv_10.42.42.10(pid=14786): Terminated {rc=256} 05:54:26.462311 --- ParallelTerminationStrategy: PID 14789 died... 05:54:26.482306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14789): Terminated: ok {rc=0} 05:54:26.528715 --- ParallelTerminationStrategy: PID 14792 died... 05:54:26.548556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14792): Terminated: ok {rc=0} 05:54:26.595341 --- ParallelTerminationStrategy: PID 14795 died... 05:54:26.615276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14795): Terminated: ok {rc=0} 05:54:26.703546 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:54:27.855069 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.867228 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:27.940462 tst iperf3m4.py: using LAC 38860 05:54:28.073035 tst iperf3m4.py: using RAC 100 05:54:28.203565 tst iperf3m4.py: using CellId 38860 05:54:28.335585 tst iperf3m4.py: using BVCI 38861 05:54:28.459249 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.470728 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.482206 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.493483 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.504608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.515790 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.527145 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.538301 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:28.549768 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:28.669472 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:28.791237 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:28.914245 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:29.033424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:54:29.247173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:29.564485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14797): Launched 05:54:29.840079 run iperf3-srv_10.42.42.10(pid=14798): Launched 05:54:29.958614 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:54:30.171127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:30.488281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14799): Launched 05:54:30.763260 run iperf3-srv_10.42.42.10(pid=14800): Launched 05:54:30.894316 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:54:31.155847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:31.502377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14801): Launched 05:54:31.814787 run iperf3-srv_10.42.42.10(pid=14802): Launched 05:54:31.957535 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:54:32.192282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:32.531822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14803): Launched 05:54:32.824172 run iperf3-srv_10.42.42.10(pid=14804): Launched 05:54:32.950008 tst iperf3m4.py:8: start network... 05:54:33.176018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:33.695684 run create_hlr_db(pid=14805): Launched 05:54:33.832048 bus /gobi_6: Setting Powered False 05:54:34.898361 run create_hlr_db(pid=14805): Terminated: ok {rc=0} 05:54:35.346540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Launched 05:54:35.663500 run osmo-hlr_10.42.42.2(pid=14808): Launched 05:54:35.785455 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:36.325076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14810): Launched 05:54:36.639615 run osmo-stp_10.42.42.5(pid=14811): Launched 05:54:36.759851 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:37.302866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14813): Launched 05:54:37.423367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:37.689661 run patchelf(pid=14814): Launched 05:54:37.863951 run osmo-stp_10.42.42.5(pid=14811): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14811)] 05:54:37.997100 run osmo-stp_10.42.42.5(pid=14811): stdout: | (launched: 2022-12-14_05:54:36.582077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:38.132197 run osmo-stp_10.42.42.5(pid=14811): stderr: | 20221214055436754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055436754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055436754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055436754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055436755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055436755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055436755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:38.267069 run osmo-stp_10.42.42.5(pid=14811): stdout: | (launched: 2022-12-14_05:54:36.582077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:38.395607 run osmo-stp_10.42.42.5(pid=14811): stderr: | 20221214055436754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055436754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055436754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055436754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055436755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055436755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055436755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:38.547993 run patchelf(pid=14814): Terminating (SIGINT) 05:54:38.724421 run patchelf(pid=14814): Terminated: ok {rc=0} 05:54:38.851232 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14811): Process ended prematurely: osmo-stp_10.42.42.5(pid=14811) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14811)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:54:38.860888 tst iperf3m4.py:8: Test FAILED (11.0 sec) 05:54:38.888425 run osmo-hlr_10.42.42.2(pid=14808): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14808)] 05:54:38.937095 run osmo-hlr_10.42.42.2(pid=14808): stdout: | (launched: 2022-12-14_05:54:35.605603) 05:54:38.987080 run osmo-hlr_10.42.42.2(pid=14808): stderr: | 20221214055435781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055435781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055435781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055435781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055435781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055435781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055435813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055435822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055435822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055435822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:39.037426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14797): Terminating (SIGTERM) 05:54:39.078029 run iperf3-srv_10.42.42.10(pid=14798): Terminating (SIGTERM) 05:54:39.118472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14799): Terminating (SIGTERM) 05:54:39.158820 run iperf3-srv_10.42.42.10(pid=14800): Terminating (SIGTERM) 05:54:39.199179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14801): Terminating (SIGTERM) 05:54:39.239435 run iperf3-srv_10.42.42.10(pid=14802): Terminating (SIGTERM) 05:54:39.279562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14803): Terminating (SIGTERM) 05:54:39.319929 run iperf3-srv_10.42.42.10(pid=14804): Terminating (SIGTERM) 05:54:39.360132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Terminating (SIGTERM) 05:54:39.400539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14810): Terminating (SIGTERM) 05:54:39.440741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14813): Terminating (SIGTERM) 05:54:39.481225 --- ParallelTerminationStrategy: PID 14797 died... 05:54:39.501028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14797): Terminated: ok {rc=0} 05:54:39.545585 --- ParallelTerminationStrategy: PID 14798 died... 05:54:39.564726 run iperf3-srv_10.42.42.10(pid=14798): Terminated {rc=256} 05:54:39.609242 --- ParallelTerminationStrategy: PID 14799 died... 05:54:39.628215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14799): Terminated: ok {rc=0} 05:54:39.672755 --- ParallelTerminationStrategy: PID 14800 died... 05:54:39.691950 run iperf3-srv_10.42.42.10(pid=14800): Terminated {rc=256} 05:54:39.736291 --- ParallelTerminationStrategy: PID 14801 died... 05:54:39.755520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14801): Terminated: ok {rc=0} 05:54:39.799996 --- ParallelTerminationStrategy: PID 14802 died... 05:54:39.819052 run iperf3-srv_10.42.42.10(pid=14802): Terminated {rc=256} 05:54:39.863485 --- ParallelTerminationStrategy: PID 14803 died... 05:54:39.882808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14803): Terminated: ok {rc=0} 05:54:39.927294 --- ParallelTerminationStrategy: PID 14804 died... 05:54:39.946529 run iperf3-srv_10.42.42.10(pid=14804): Terminated {rc=256} 05:54:39.990841 --- ParallelTerminationStrategy: PID 14807 died... 05:54:40.010062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Terminated: ok {rc=0} 05:54:40.054925 --- ParallelTerminationStrategy: PID 14810 died... 05:54:40.074135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14810): Terminated: ok {rc=0} 05:54:40.118703 --- ParallelTerminationStrategy: PID 14813 died... 05:54:40.138095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14813): Terminated: ok {rc=0} 05:54:40.223200 bus /gobi_4: Setting Powered False 05:54:41.322592 bus /gobi_4: Setting Powered False 05:54:42.439389 bus /gobi_1: Setting Powered False 05:54:43.539086 bus /gobi_1: Setting Powered False 05:54:44.656442 bus /gobi_0: Setting Powered False 05:54:45.754666 bus /gobi_0: Setting Powered False 05:54:46.879534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:54:47.984202 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:47.996431 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:48.067710 tst ping.py: using LAC 38861 05:54:48.196421 tst ping.py: using RAC 101 05:54:48.327449 tst ping.py: using CellId 38861 05:54:48.458529 tst ping.py: using BVCI 38862 05:54:48.580336 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.591939 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.603169 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.614408 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.626024 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.637460 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.648817 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:48.660199 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:48.777426 tst ping.py:19: start network... 05:54:48.986014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:49.463572 run create_hlr_db(pid=14815): Launched 05:54:49.582544 bus /gobi_6: Setting Powered False 05:54:50.643623 run create_hlr_db(pid=14815): Terminated: ok {rc=0} 05:54:51.074350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14817): Launched 05:54:51.383840 run osmo-hlr_10.42.42.2(pid=14818): Launched 05:54:51.502402 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:52.056691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14820): Launched 05:54:52.365086 run osmo-stp_10.42.42.5(pid=14821): Launched 05:54:52.483350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:53.032134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14823): Launched 05:54:53.159143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:53.437548 run patchelf(pid=14824): Launched 05:54:53.620183 run osmo-stp_10.42.42.5(pid=14821): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14821)] 05:54:53.759366 run osmo-stp_10.42.42.5(pid=14821): stdout: | (launched: 2022-12-14_05:54:52.308064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:53.899954 run osmo-stp_10.42.42.5(pid=14821): stderr: | 20221214055452478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055452478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055452478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055452479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055452479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055452479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055452479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:54.040395 run osmo-stp_10.42.42.5(pid=14821): stdout: | (launched: 2022-12-14_05:54:52.308064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:54.174774 run osmo-stp_10.42.42.5(pid=14821): stderr: | 20221214055452478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055452478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055452478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055452479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055452479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055452479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055452479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:54.334045 run patchelf(pid=14824): Terminating (SIGINT) 05:54:54.517298 run patchelf(pid=14824): Terminated: ok {rc=0} 05:54:54.649602 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14821): Process ended prematurely: osmo-stp_10.42.42.5(pid=14821) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14821)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 05:54:54.659254 tst ping.py:22: Test FAILED (6.7 sec) 05:54:54.687869 run osmo-hlr_10.42.42.2(pid=14818): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14818)] 05:54:54.738097 run osmo-hlr_10.42.42.2(pid=14818): stdout: | (launched: 2022-12-14_05:54:51.327167) 05:54:54.790219 run osmo-hlr_10.42.42.2(pid=14818): stderr: | 20221214055451505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055451505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055451505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055451505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055451505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055451505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055451518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055451526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055451526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055451526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:54.842829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14817): Terminating (SIGTERM) 05:54:54.885747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14820): Terminating (SIGTERM) 05:54:54.928749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14823): Terminating (SIGTERM) 05:54:54.971632 --- ParallelTerminationStrategy: PID 14817 died... 05:54:54.992000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14817): Terminated: ok {rc=0} 05:54:55.038872 --- ParallelTerminationStrategy: PID 14820 died... 05:54:55.058825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14820): Terminated: ok {rc=0} 05:54:55.105644 --- ParallelTerminationStrategy: PID 14823 died... 05:54:55.125567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14823): Terminated: ok {rc=0} 05:54:55.213350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:54:56.301924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.313638 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:56.385281 tst ping_idle_ping.py: using LAC 38862 05:54:56.508099 tst ping_idle_ping.py: using RAC 102 05:54:56.630909 tst ping_idle_ping.py: using CellId 38862 05:54:56.753968 tst ping_idle_ping.py: using BVCI 38863 05:54:56.868633 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.879631 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.890445 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.901235 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.912042 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.923128 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.934177 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:56.945204 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:57.061604 tst ping_idle_ping.py:24: start network... 05:54:57.270429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:57.754846 run create_hlr_db(pid=14825): Launched 05:54:57.875435 bus /gobi_6: Setting Powered False 05:54:58.936874 run create_hlr_db(pid=14825): Terminated: ok {rc=0} 05:54:59.389148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14827): Launched 05:54:59.720191 run osmo-hlr_10.42.42.2(pid=14828): Launched 05:54:59.847439 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:00.418489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14830): Launched 05:55:00.748025 run osmo-stp_10.42.42.5(pid=14831): Launched 05:55:00.913995 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:01.674697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14833): Launched 05:55:01.845244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:02.171155 run patchelf(pid=14837): Launched 05:55:02.374042 run osmo-stp_10.42.42.5(pid=14831): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14831)] 05:55:02.513197 run osmo-stp_10.42.42.5(pid=14831): stdout: | (launched: 2022-12-14_05:55:00.687702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:02.655315 run osmo-stp_10.42.42.5(pid=14831): stderr: | 20221214055500965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055500965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055500966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055500966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055500966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055500966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055500967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:02.797138 run osmo-stp_10.42.42.5(pid=14831): stdout: | (launched: 2022-12-14_05:55:00.687702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:02.931936 run osmo-stp_10.42.42.5(pid=14831): stderr: | 20221214055500965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055500965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055500966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055500966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055500966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055500966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055500967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:03.091959 run patchelf(pid=14837): Terminating (SIGINT) 05:55:03.275446 run patchelf(pid=14837): Terminated: ok {rc=0} 05:55:03.407825 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14831): Process ended prematurely: osmo-stp_10.42.42.5(pid=14831) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14831)] [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:55:03.417622 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 05:55:03.446047 run osmo-hlr_10.42.42.2(pid=14828): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14828)] 05:55:03.496941 run osmo-hlr_10.42.42.2(pid=14828): stdout: | (launched: 2022-12-14_05:54:59.660088) 05:55:03.549633 run osmo-hlr_10.42.42.2(pid=14828): stderr: | 20221214055459859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055459859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055459859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055459860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055459860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055459860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055459872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055459880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055459881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055459881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:03.603056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14827): Terminating (SIGTERM) 05:55:03.645812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14830): Terminating (SIGTERM) 05:55:03.689219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14833): Terminating (SIGTERM) 05:55:03.732289 --- ParallelTerminationStrategy: PID 14827 died... 05:55:03.752570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14827): Terminated: ok {rc=0} 05:55:03.799254 --- ParallelTerminationStrategy: PID 14830 died... 05:55:03.819068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14830): Terminated: ok {rc=0} 05:55:03.865651 --- ParallelTerminationStrategy: PID 14833 died... 05:55:03.885479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14833): Terminated: ok {rc=0} 05:55:03.974044 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 05:55:05.281173 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:05.288082 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 05:55:05.321607 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 05:55:05.360649 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 05:55:05.445168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 05:55:05.477727 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 05:55:05.515740 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 05:55:06.116184 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 05:55:06.173781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.186175 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:06.239414 tst cs_paging_gprs_active.py: using LAC 38863 05:55:06.371846 tst cs_paging_gprs_active.py: using RAC 103 05:55:06.500875 tst cs_paging_gprs_active.py: using CellId 38863 05:55:06.630845 tst cs_paging_gprs_active.py: using BVCI 38864 05:55:06.754352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.766531 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.778435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.790244 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.801963 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.813617 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.825436 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.836875 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:06.848782 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:06.968256 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:07.086843 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:55:07.300488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:07.618904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14842): Launched 05:55:07.897656 run iperf3-srv_10.42.42.10(pid=14843): Launched 05:55:08.016626 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:55:08.229836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:08.547785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14844): Launched 05:55:08.823892 run iperf3-srv_10.42.42.10(pid=14845): Launched 05:55:08.943037 tst cs_paging_gprs_active.py:38: start network... 05:55:09.155634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:09.643493 run create_hlr_db(pid=14846): Launched 05:55:09.765353 bus /gobi_6: Setting Powered False 05:55:10.826422 run create_hlr_db(pid=14846): Terminated: ok {rc=0} 05:55:11.284660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14848): Launched 05:55:11.620116 run osmo-hlr_10.42.42.2(pid=14849): Launched 05:55:11.748107 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:12.330199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14851): Launched 05:55:12.666212 run osmo-stp_10.42.42.5(pid=14852): Launched 05:55:12.796151 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:13.378756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14854): Launched 05:55:13.507018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:13.791245 run patchelf(pid=14855): Launched 05:55:13.977604 run osmo-stp_10.42.42.5(pid=14852): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14852)] 05:55:14.119471 run osmo-stp_10.42.42.5(pid=14852): stdout: | (launched: 2022-12-14_05:55:12.604853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:14.262908 run osmo-stp_10.42.42.5(pid=14852): stderr: | 20221214055512799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055512799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055512800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055512800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055512801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055512801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055512801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:14.406200 run osmo-stp_10.42.42.5(pid=14852): stdout: | (launched: 2022-12-14_05:55:12.604853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:14.542888 run osmo-stp_10.42.42.5(pid=14852): stderr: | 20221214055512799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055512799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055512800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055512800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055512801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055512801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055512801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:14.706016 run patchelf(pid=14855): Terminating (SIGINT) 05:55:14.894158 run patchelf(pid=14855): Terminated: ok {rc=0} 05:55:15.029253 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14852): Process ended prematurely: osmo-stp_10.42.42.5(pid=14852) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14852)] [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 05:55:15.039644 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:55:15.068506 run osmo-hlr_10.42.42.2(pid=14849): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14849)] 05:55:15.119248 run osmo-hlr_10.42.42.2(pid=14849): stdout: | (launched: 2022-12-14_05:55:11.558690) 05:55:15.171565 run osmo-hlr_10.42.42.2(pid=14849): stderr: | 20221214055511757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055511757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055511757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055511757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055511757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055511757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055511769 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055511778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055511778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055511778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:15.224356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14842): Terminating (SIGTERM) 05:55:15.266843 run iperf3-srv_10.42.42.10(pid=14843): Terminating (SIGTERM) 05:55:15.310588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14844): Terminating (SIGTERM) 05:55:15.353074 run iperf3-srv_10.42.42.10(pid=14845): Terminating (SIGTERM) 05:55:15.395505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14848): Terminating (SIGTERM) 05:55:15.438299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14851): Terminating (SIGTERM) 05:55:15.480456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14854): Terminating (SIGTERM) 05:55:15.523464 --- ParallelTerminationStrategy: PID 14842 died... 05:55:15.543553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14842): Terminated: ok {rc=0} 05:55:15.590562 --- ParallelTerminationStrategy: PID 14843 died... 05:55:15.610364 run iperf3-srv_10.42.42.10(pid=14843): Terminated {rc=256} 05:55:15.656797 --- ParallelTerminationStrategy: PID 14844 died... 05:55:15.677068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14844): Terminated: ok {rc=0} 05:55:15.723509 --- ParallelTerminationStrategy: PID 14845 died... 05:55:15.743311 run iperf3-srv_10.42.42.10(pid=14845): Terminated {rc=256} 05:55:15.789855 --- ParallelTerminationStrategy: PID 14848 died... 05:55:15.809707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14848): Terminated: ok {rc=0} 05:55:15.866972 --- ParallelTerminationStrategy: PID 14851 died... 05:55:15.895905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14851): Terminated: ok {rc=0} 05:55:15.948442 --- ParallelTerminationStrategy: PID 14854 died... 05:55:15.968921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14854): Terminated: ok {rc=0} 05:55:16.060934 bus /gobi_0: Setting Powered False 05:55:17.168027 bus /gobi_0: Setting Powered False 05:55:18.300848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 05:55:19.450815 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.463021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:19.518433 tst iperf3.py: using LAC 38864 05:55:19.643235 tst iperf3.py: using RAC 104 05:55:19.768499 tst iperf3.py: using CellId 38864 05:55:19.898025 tst iperf3.py: using BVCI 38865 05:55:20.013691 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.024811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.035955 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.046966 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.058320 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.069679 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.081194 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.092409 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:20.103852 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:20.225360 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:55:20.453384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:20.791727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14856): Launched 05:55:21.084373 run iperf3-srv_10.42.42.10(pid=14857): Launched 05:55:21.210165 tst iperf3.py:8: start network... 05:55:21.437138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:21.958731 run create_hlr_db(pid=14858): Launched 05:55:22.095687 bus /gobi_6: Setting Powered False 05:55:23.161129 run create_hlr_db(pid=14858): Terminated: ok {rc=0} 05:55:23.627754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14860): Launched 05:55:23.962560 run osmo-hlr_10.42.42.2(pid=14861): Launched 05:55:24.090949 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:24.675169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14863): Launched 05:55:25.009992 run osmo-stp_10.42.42.5(pid=14864): Launched 05:55:25.137561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:25.716294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14866): Launched 05:55:25.844533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:26.128592 run patchelf(pid=14867): Launched 05:55:26.314791 run osmo-stp_10.42.42.5(pid=14864): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14864)] 05:55:26.456074 run osmo-stp_10.42.42.5(pid=14864): stdout: | (launched: 2022-12-14_05:55:24.948936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:26.599929 run osmo-stp_10.42.42.5(pid=14864): stderr: | 20221214055525142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055525142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055525142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055525143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055525143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055525144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055525144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:26.743473 run osmo-stp_10.42.42.5(pid=14864): stdout: | (launched: 2022-12-14_05:55:24.948936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:26.880168 run osmo-stp_10.42.42.5(pid=14864): stderr: | 20221214055525142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055525142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055525142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055525143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055525143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055525144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055525144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:27.042783 run patchelf(pid=14867): Terminating (SIGINT) 05:55:27.230854 run patchelf(pid=14867): Terminated: ok {rc=0} 05:55:27.366113 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14864): Process ended prematurely: osmo-stp_10.42.42.5(pid=14864) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14864)] [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 05:55:27.376512 tst iperf3.py:8: Test FAILED (8.0 sec) 05:55:27.405429 run osmo-hlr_10.42.42.2(pid=14861): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14861)] 05:55:27.455685 run osmo-hlr_10.42.42.2(pid=14861): stdout: | (launched: 2022-12-14_05:55:23.901753) 05:55:27.507890 run osmo-hlr_10.42.42.2(pid=14861): stderr: | 20221214055524103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055524103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055524103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055524103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055524103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055524103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055524116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055524124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055524124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055524124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:27.560416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14856): Terminating (SIGTERM) 05:55:27.603116 run iperf3-srv_10.42.42.10(pid=14857): Terminating (SIGTERM) 05:55:27.645828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14860): Terminating (SIGTERM) 05:55:27.688077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14863): Terminating (SIGTERM) 05:55:27.730425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14866): Terminating (SIGTERM) 05:55:27.772827 --- ParallelTerminationStrategy: PID 14856 died... 05:55:27.793082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14856): Terminated: ok {rc=0} 05:55:27.839527 --- ParallelTerminationStrategy: PID 14857 died... 05:55:27.859136 run iperf3-srv_10.42.42.10(pid=14857): Terminated {rc=256} 05:55:27.905289 --- ParallelTerminationStrategy: PID 14860 died... 05:55:27.925046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14860): Terminated: ok {rc=0} 05:55:27.971436 --- ParallelTerminationStrategy: PID 14863 died... 05:55:27.991139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14863): Terminated: ok {rc=0} 05:55:28.037594 --- ParallelTerminationStrategy: PID 14866 died... 05:55:28.057394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14866): Terminated: ok {rc=0} 05:55:28.146158 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 05:55:29.293376 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.305710 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:29.358979 tst iperf3m4.py: using LAC 38865 05:55:29.484235 tst iperf3m4.py: using RAC 105 05:55:29.608824 tst iperf3m4.py: using CellId 38865 05:55:29.733634 tst iperf3m4.py: using BVCI 38866 05:55:29.849823 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.861310 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.872411 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.883559 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.895036 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.906508 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.918103 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.929549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:29.940892 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:30.063310 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:30.183719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:30.306227 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:30.427511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:55:30.640863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:30.983027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14868): Launched 05:55:31.291237 run iperf3-srv_10.42.42.10(pid=14869): Launched 05:55:31.436918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:55:31.671079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:32.019373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14870): Launched 05:55:32.312618 run iperf3-srv_10.42.42.10(pid=14871): Launched 05:55:32.431418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:55:32.643700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:32.960934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14872): Launched 05:55:33.236413 run iperf3-srv_10.42.42.10(pid=14873): Launched 05:55:33.354854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:55:33.566853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:33.883539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14874): Launched 05:55:34.158178 run iperf3-srv_10.42.42.10(pid=14875): Launched 05:55:34.277917 tst iperf3m4.py:8: start network... 05:55:34.489334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:34.976765 run create_hlr_db(pid=14876): Launched 05:55:35.097766 bus /gobi_6: Setting Powered False 05:55:36.159744 run create_hlr_db(pid=14876): Terminated: ok {rc=0} 05:55:36.617782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14878): Launched 05:55:36.955740 run osmo-hlr_10.42.42.2(pid=14879): Launched 05:55:37.085639 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:37.669364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14881): Launched 05:55:38.004785 run osmo-stp_10.42.42.5(pid=14882): Launched 05:55:38.130954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:38.710753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14884): Launched 05:55:38.838874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:39.123042 run patchelf(pid=14885): Launched 05:55:39.310146 run osmo-stp_10.42.42.5(pid=14882): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14882)] 05:55:39.451525 run osmo-stp_10.42.42.5(pid=14882): stdout: | (launched: 2022-12-14_05:55:37.943241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:39.594817 run osmo-stp_10.42.42.5(pid=14882): stderr: | 20221214055538135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055538136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055538136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055538136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055538137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055538137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055538137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:39.737637 run osmo-stp_10.42.42.5(pid=14882): stdout: | (launched: 2022-12-14_05:55:37.943241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:39.874131 run osmo-stp_10.42.42.5(pid=14882): stderr: | 20221214055538135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055538136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055538136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055538136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055538137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055538137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055538137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:40.036338 run patchelf(pid=14885): Terminating (SIGINT) 05:55:40.223260 run patchelf(pid=14885): Terminated: ok {rc=0} 05:55:40.358185 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14882): Process ended prematurely: osmo-stp_10.42.42.5(pid=14882) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14882)] [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 05:55:40.368680 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:55:40.397710 run osmo-hlr_10.42.42.2(pid=14879): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14879)] 05:55:40.447984 run osmo-hlr_10.42.42.2(pid=14879): stdout: | (launched: 2022-12-14_05:55:36.894037) 05:55:40.499940 run osmo-hlr_10.42.42.2(pid=14879): stderr: | 20221214055537094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055537095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055537095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055537095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055537095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055537095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055537107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055537118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055537118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055537118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:40.552054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14868): Terminating (SIGTERM) 05:55:40.594335 run iperf3-srv_10.42.42.10(pid=14869): Terminating (SIGTERM) 05:55:40.636202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14870): Terminating (SIGTERM) 05:55:40.678274 run iperf3-srv_10.42.42.10(pid=14871): Terminating (SIGTERM) 05:55:40.720069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14872): Terminating (SIGTERM) 05:55:40.761911 run iperf3-srv_10.42.42.10(pid=14873): Terminating (SIGTERM) 05:55:40.803638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14874): Terminating (SIGTERM) 05:55:40.845496 run iperf3-srv_10.42.42.10(pid=14875): Terminating (SIGTERM) 05:55:40.887158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14878): Terminating (SIGTERM) 05:55:40.929086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14881): Terminating (SIGTERM) 05:55:40.970889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14884): Terminating (SIGTERM) 05:55:41.013118 --- ParallelTerminationStrategy: PID 14868 died... 05:55:41.033201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14868): Terminated: ok {rc=0} 05:55:41.079990 --- ParallelTerminationStrategy: PID 14869 died... 05:55:41.099497 run iperf3-srv_10.42.42.10(pid=14869): Terminated {rc=256} 05:55:41.145724 --- ParallelTerminationStrategy: PID 14870 died... 05:55:41.165437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14870): Terminated: ok {rc=0} 05:55:41.211614 --- ParallelTerminationStrategy: PID 14871 died... 05:55:41.231197 run iperf3-srv_10.42.42.10(pid=14871): Terminated {rc=256} 05:55:41.277265 --- ParallelTerminationStrategy: PID 14872 died... 05:55:41.296758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14872): Terminated: ok {rc=0} 05:55:41.342942 --- ParallelTerminationStrategy: PID 14873 died... 05:55:41.362479 run iperf3-srv_10.42.42.10(pid=14873): Terminated {rc=256} 05:55:41.408506 --- ParallelTerminationStrategy: PID 14874 died... 05:55:41.428159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14874): Terminated: ok {rc=0} 05:55:41.474133 --- ParallelTerminationStrategy: PID 14875 died... 05:55:41.493751 run iperf3-srv_10.42.42.10(pid=14875): Terminated {rc=256} 05:55:41.539608 --- ParallelTerminationStrategy: PID 14878 died... 05:55:41.559261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14878): Terminated: ok {rc=0} 05:55:41.605731 --- ParallelTerminationStrategy: PID 14881 died... 05:55:41.625353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14881): Terminated: ok {rc=0} 05:55:41.671476 --- ParallelTerminationStrategy: PID 14884 died... 05:55:41.691072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14884): Terminated: ok {rc=0} 05:55:41.779177 bus /gobi_4: Setting Powered False 05:55:42.878078 bus /gobi_4: Setting Powered False 05:55:43.993947 bus /gobi_1: Setting Powered False 05:55:45.092893 bus /gobi_1: Setting Powered False 05:55:46.223238 bus /gobi_0: Setting Powered False 05:55:47.338824 bus /gobi_0: Setting Powered False 05:55:48.454199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 05:55:49.558049 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:49.570416 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:49.625155 tst ping.py: using LAC 38866 05:55:49.756175 tst ping.py: using RAC 106 05:55:49.878349 tst ping.py: using CellId 38866 05:55:50.001146 tst ping.py: using BVCI 38867 05:55:50.113796 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.125271 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.136451 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.147732 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.159131 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.170686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.182367 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:50.193841 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:50.313561 tst ping.py:19: start network... 05:55:50.522603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:51.003862 run create_hlr_db(pid=14886): Launched 05:55:51.122153 bus /gobi_6: Setting Powered False 05:55:52.184050 run create_hlr_db(pid=14886): Terminated: ok {rc=0} 05:55:52.617009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14890): Launched 05:55:52.926606 run osmo-hlr_10.42.42.2(pid=14891): Launched 05:55:53.045241 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:53.597493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14893): Launched 05:55:53.906658 run osmo-stp_10.42.42.5(pid=14894): Launched 05:55:54.026562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:54.566343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14896): Launched 05:55:54.684574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:54.946962 run patchelf(pid=14897): Launched 05:55:55.120845 run osmo-stp_10.42.42.5(pid=14894): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14894)] 05:55:55.253114 run osmo-stp_10.42.42.5(pid=14894): stdout: | (launched: 2022-12-14_05:55:53.850153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:55.385928 run osmo-stp_10.42.42.5(pid=14894): stderr: | 20221214055554024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055554024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055554024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055554024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055554025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055554025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055554025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:55.518839 run osmo-stp_10.42.42.5(pid=14894): stdout: | (launched: 2022-12-14_05:55:53.850153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:55.646018 run osmo-stp_10.42.42.5(pid=14894): stderr: | 20221214055554024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055554024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055554024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055554024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055554025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055554025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055554025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:55.796237 run patchelf(pid=14897): Terminating (SIGINT) 05:55:55.969930 run patchelf(pid=14897): Terminated: ok {rc=0} 05:55:56.095711 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14894): Process ended prematurely: osmo-stp_10.42.42.5(pid=14894) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14894)] [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 05:55:56.105121 tst ping.py:22: Test FAILED (6.5 sec) 05:55:56.132275 run osmo-hlr_10.42.42.2(pid=14891): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14891)] 05:55:56.181122 run osmo-hlr_10.42.42.2(pid=14891): stdout: | (launched: 2022-12-14_05:55:52.869910) 05:55:56.231311 run osmo-hlr_10.42.42.2(pid=14891): stderr: | 20221214055553047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055553047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055553047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055553047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055553047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055553047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055553059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055553067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055553067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055553067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:56.281899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14890): Terminating (SIGTERM) 05:55:56.322611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14893): Terminating (SIGTERM) 05:55:56.363197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14896): Terminating (SIGTERM) 05:55:56.404167 --- ParallelTerminationStrategy: PID 14890 died... 05:55:56.424008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14890): Terminated: ok {rc=0} 05:55:56.469085 --- ParallelTerminationStrategy: PID 14893 died... 05:55:56.488345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14893): Terminated: ok {rc=0} 05:55:56.533260 --- ParallelTerminationStrategy: PID 14896 died... 05:55:56.552470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14896): Terminated: ok {rc=0} 05:55:56.640443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 05:55:57.730061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:57.742857 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:57.797638 tst ping_idle_ping.py: using LAC 38867 05:55:57.920878 tst ping_idle_ping.py: using RAC 107 05:55:58.043312 tst ping_idle_ping.py: using CellId 38867 05:55:58.164773 tst ping_idle_ping.py: using BVCI 38868 05:55:58.277730 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.289416 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.300456 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.311622 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.322935 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.334441 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.345988 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:58.357384 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:58.474668 tst ping_idle_ping.py:24: start network... 05:55:58.684739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:59.169760 run create_hlr_db(pid=14898): Launched 05:55:59.289504 bus /gobi_6: Setting Powered False 05:56:00.352027 run create_hlr_db(pid=14898): Terminated: ok {rc=0} 05:56:00.806283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14900): Launched 05:56:01.156260 run osmo-hlr_10.42.42.2(pid=14901): Launched 05:56:01.405702 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:02.057885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14903): Launched 05:56:02.400795 run osmo-stp_10.42.42.5(pid=14904): Launched 05:56:02.527123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:56:03.100622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14906): Launched 05:56:03.226636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:56:03.505978 run patchelf(pid=14907): Launched 05:56:03.691672 run osmo-stp_10.42.42.5(pid=14904): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14904)] 05:56:03.831535 run osmo-stp_10.42.42.5(pid=14904): stdout: | (launched: 2022-12-14_05:56:02.340259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:03.972735 run osmo-stp_10.42.42.5(pid=14904): stderr: | 20221214055602534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055602534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055602534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055602535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055602535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055602535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055602535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:04.116195 run osmo-stp_10.42.42.5(pid=14904): stdout: | (launched: 2022-12-14_05:56:02.340259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:04.251522 run osmo-stp_10.42.42.5(pid=14904): stderr: | 20221214055602534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055602534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055602534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055602535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055602535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055602535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055602535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:04.411640 run patchelf(pid=14907): Terminating (SIGINT) 05:56:04.595918 run patchelf(pid=14907): Terminated: ok {rc=0} 05:56:04.729220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14904): Process ended prematurely: osmo-stp_10.42.42.5(pid=14904) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14904)] [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 05:56:04.739139 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 05:56:04.767533 run osmo-hlr_10.42.42.2(pid=14901): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14901)] 05:56:04.818114 run osmo-hlr_10.42.42.2(pid=14901): stdout: | (launched: 2022-12-14_05:56:01.095995) 05:56:04.870486 run osmo-hlr_10.42.42.2(pid=14901): stderr: | 20221214055601396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055601396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055601396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055601396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055601396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055601396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055601414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055601436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055601443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055601443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:04.923173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14900): Terminating (SIGTERM) 05:56:04.965641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14903): Terminating (SIGTERM) 05:56:05.008825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14906): Terminating (SIGTERM) 05:56:05.051722 --- ParallelTerminationStrategy: PID 14900 died... 05:56:05.072072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14900): Terminated: ok {rc=0} 05:56:05.119217 --- ParallelTerminationStrategy: PID 14903 died... 05:56:05.139149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14903): Terminated: ok {rc=0} 05:56:05.185990 --- ParallelTerminationStrategy: PID 14906 died... 05:56:05.205918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14906): Terminated: ok {rc=0} 05:56:05.295130 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:56:06.607046 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:06.614011 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:56:06.647135 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:56:06.682295 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:56:06.735365 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:56:06.769334 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:56:06.804416 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:56:07.359355 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:56:07.364627 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.376141 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:56:07.445063 tst switch_tch_pdch.py: using LAC 38868 05:56:07.568178 tst switch_tch_pdch.py: using RAC 108 05:56:07.691140 tst switch_tch_pdch.py: using CellId 38868 05:56:07.813328 tst switch_tch_pdch.py: using BVCI 38869 05:56:07.925820 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.937241 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.948359 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.959485 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.970905 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.982308 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:07.993893 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:56:08.005317 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:56:08.125357 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:56:08.246791 tst switch_tch_pdch.py:51: start network... 05:56:08.469674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:08.980261 run create_hlr_db(pid=14912): Launched 05:56:09.114346 bus /gobi_6: Setting Powered False 05:56:10.180494 run create_hlr_db(pid=14912): Terminated: ok {rc=0} 05:56:10.623441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14914): Launched 05:56:10.934407 run osmo-hlr_10.42.42.2(pid=14915): Launched 05:56:11.053818 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:11.602563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14917): Launched 05:56:11.912493 run osmo-stp_10.42.42.5(pid=14918): Launched 05:56:12.031607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:56:12.565139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14920): Launched 05:56:12.682876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:56:12.943110 run patchelf(pid=14921): Launched 05:56:13.114646 run osmo-stp_10.42.42.5(pid=14918): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14918)] 05:56:13.245108 run osmo-stp_10.42.42.5(pid=14918): stdout: | (launched: 2022-12-14_05:56:11.855703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:13.378193 run osmo-stp_10.42.42.5(pid=14918): stderr: | 20221214055612029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055612029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055612029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055612029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055612030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055612030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055612030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:13.510795 run osmo-stp_10.42.42.5(pid=14918): stdout: | (launched: 2022-12-14_05:56:11.855703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:13.636817 run osmo-stp_10.42.42.5(pid=14918): stderr: | 20221214055612029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055612029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055612029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055612029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055612030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055612030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055612030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:13.786883 run patchelf(pid=14921): Terminating (SIGINT) 05:56:13.959735 run patchelf(pid=14921): Terminated: ok {rc=0} 05:56:14.084222 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14918): Process ended prematurely: osmo-stp_10.42.42.5(pid=14918) [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14918)] [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:56:14.093421 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 05:56:14.120226 run osmo-hlr_10.42.42.2(pid=14915): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14915)] 05:56:14.168376 run osmo-hlr_10.42.42.2(pid=14915): stdout: | (launched: 2022-12-14_05:56:10.877823) 05:56:14.218100 run osmo-hlr_10.42.42.2(pid=14915): stderr: | 20221214055611052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055611052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055611052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055611052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055611052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055611052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055611065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055611073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055611073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055611073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:14.268115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14914): Terminating (SIGTERM) 05:56:14.308528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14917): Terminating (SIGTERM) 05:56:14.349025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14920): Terminating (SIGTERM) 05:56:14.389574 --- ParallelTerminationStrategy: PID 14914 died... 05:56:14.409255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14914): Terminated: ok {rc=0} 05:56:14.453404 --- ParallelTerminationStrategy: PID 14917 died... 05:56:14.472238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14917): Terminated: ok {rc=0} 05:56:14.516345 --- ParallelTerminationStrategy: PID 14920 died... 05:56:14.535322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14920): Terminated: ok {rc=0} 05:56:14.620094 bus /gobi_0: Setting Powered False 05:56:15.718514 bus /gobi_0: Setting Powered False 05:56:16.837236 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:56:18.096355 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:18.102680 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:56:18.136728 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:56:18.172111 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:56:18.227072 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:56:18.259864 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:56:18.293897 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:56:18.848571 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:56:18.853909 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:18.864727 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:56:18.933915 tst switch_tch_pdch.py: using LAC 38869 05:56:19.059933 tst switch_tch_pdch.py: using RAC 109 05:56:19.180497 tst switch_tch_pdch.py: using CellId 38869 05:56:19.300223 tst switch_tch_pdch.py: using BVCI 38870 05:56:19.413101 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.424034 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.434815 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.445583 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.456523 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.468069 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.479218 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:56:19.490287 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:56:19.610221 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:56:19.728909 tst switch_tch_pdch.py:51: start network... 05:56:19.952063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:20.433467 run create_hlr_db(pid=14925): Launched 05:56:20.566682 bus /gobi_6: Setting Powered False 05:56:21.632501 run create_hlr_db(pid=14925): Terminated: ok {rc=0} 05:56:22.047426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14927): Launched 05:56:22.356508 run osmo-hlr_10.42.42.2(pid=14928): Launched 05:56:22.474522 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:22.994288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14930): Launched 05:56:23.302958 run osmo-stp_10.42.42.5(pid=14931): Launched 05:56:23.423487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:56:23.930212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14933): Launched 05:56:24.049620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:56:24.311151 run patchelf(pid=14934): Launched 05:56:24.482867 run osmo-stp_10.42.42.5(pid=14931): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14931)] 05:56:24.614384 run osmo-stp_10.42.42.5(pid=14931): stdout: | (launched: 2022-12-14_05:56:23.246020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:24.746893 run osmo-stp_10.42.42.5(pid=14931): stderr: | 20221214055623420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055623420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055623420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055623421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055623421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055623421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055623421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:24.879638 run osmo-stp_10.42.42.5(pid=14931): stdout: | (launched: 2022-12-14_05:56:23.246020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:25.005859 run osmo-stp_10.42.42.5(pid=14931): stderr: | 20221214055623420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055623420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055623420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055623421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055623421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055623421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055623421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:25.155595 run patchelf(pid=14934): Terminating (SIGINT) 05:56:25.328841 run patchelf(pid=14934): Terminated: ok {rc=0} 05:56:25.454537 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14931): Process ended prematurely: osmo-stp_10.42.42.5(pid=14931) [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14931)] [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:56:25.463838 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 05:56:25.490600 run osmo-hlr_10.42.42.2(pid=14928): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14928)] 05:56:25.539313 run osmo-hlr_10.42.42.2(pid=14928): stdout: | (launched: 2022-12-14_05:56:22.299675) 05:56:25.589508 run osmo-hlr_10.42.42.2(pid=14928): stderr: | 20221214055622478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055622478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055622478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055622478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055622478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055622478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055622490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055622499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055622499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055622499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:25.640140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14927): Terminating (SIGTERM) 05:56:25.680421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14930): Terminating (SIGTERM) 05:56:25.720584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14933): Terminating (SIGTERM) 05:56:25.760894 --- ParallelTerminationStrategy: PID 14927 died... 05:56:25.780040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14927): Terminated: ok {rc=0} 05:56:25.824569 --- ParallelTerminationStrategy: PID 14930 died... 05:56:25.843694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14930): Terminated: ok {rc=0} 05:56:25.887837 --- ParallelTerminationStrategy: PID 14933 died... 05:56:25.906898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14933): Terminated: ok {rc=0} 05:56:25.993127 bus /gobi_0: Setting Powered False 05:56:27.092235 bus /gobi_0: Setting Powered False 05:56:28.208737 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:29.462513 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:29.466546 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:29.499538 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 05:56:29.506943 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 05:56:29.557081 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:29.591939 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 05:56:29.599029 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 05:56:30.139895 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 05:56:30.145789 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 05:56:30.158085 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:30.209958 tst mo_mt_sms.py: using LAC 38870 05:56:30.333114 tst mo_mt_sms.py: using RAC 110 05:56:30.452879 tst mo_mt_sms.py: using CellId 38870 05:56:30.573239 tst mo_mt_sms.py: using BVCI 38871 05:56:30.687148 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:30.801347 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:30.936236 tst mo_mt_sms.py:9: start nitb and bts... 05:56:31.208519 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:56:31.912838 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14938): Launched 05:56:32.259896 run osmo-nitb_10.42.42.2(pid=14939): Launched 05:56:32.442315 run osmo-nitb_10.42.42.2(pid=14939): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14939)] 05:56:32.589160 run osmo-nitb_10.42.42.2(pid=14939): stdout: | (launched: 2022-12-14_05:56:32.199752) 05:56:32.738212 run osmo-nitb_10.42.42.2(pid=14939): stderr: | (launched: 2022-12-14_05:56:32.248843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:32.886444 run osmo-nitb_10.42.42.2(pid=14939): stdout: | (launched: 2022-12-14_05:56:32.199752) 05:56:33.028645 run osmo-nitb_10.42.42.2(pid=14939): stderr: | (launched: 2022-12-14_05:56:32.248843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14939): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14939) [trial-2400↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14939)] 05:56:33.384577 tst osmo-nitb_10.42.42.2(pid=14939): stdout: | (launched: 2022-12-14_05:56:32.199752) 05:56:33.517187 tst osmo-nitb_10.42.42.2(pid=14939): stderr: | (launched: 2022-12-14_05:56:32.248843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:33.673486 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14939): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14939) [trial-2400↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14939)] [trial-2400↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 05:56:33.682706 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 05:56:33.689904 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14938): Terminating (SIGTERM) 05:56:33.900941 --- ParallelTerminationStrategy: PID 14938 died... 05:56:33.922639 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14938): Terminated: ok {rc=0} 05:56:34.012738 bus /sierra_3: Setting Powered False 05:56:35.114798 bus /sierra_3: Setting Powered False 05:56:36.233733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:37.438943 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:37.443277 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:37.477927 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:56:37.507215 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 05:56:37.560007 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:37.594317 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:56:37.625269 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 05:56:38.168082 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 05:56:38.173126 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:38.183840 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:38.231443 tst mo_mt_sms.py: using LAC 38871 05:56:38.350498 tst mo_mt_sms.py: using RAC 111 05:56:38.470916 tst mo_mt_sms.py: using CellId 38871 05:56:38.592928 tst mo_mt_sms.py: using BVCI 38872 05:56:38.706734 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:38.717466 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:38.728073 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:38.738569 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:38.749034 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:38.760478 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:38.876065 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:38.996559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:39.508594 run create_hlr_db(pid=14943): Launched 05:56:39.643164 bus /sierra_2: Setting Powered False 05:56:40.707632 run create_hlr_db(pid=14943): Terminated: ok {rc=0} 05:56:41.166506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14945): Launched 05:56:41.495439 run osmo-hlr_10.42.42.2(pid=14946): Launched 05:56:41.622801 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:42.188285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14948): Launched 05:56:42.516284 run osmo-stp_10.42.42.5(pid=14949): Launched 05:56:42.642307 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:43.237477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14951): Launched 05:56:43.566255 run osmo-msc_10.42.42.6(pid=14952): Launched 05:56:43.750685 run osmo-stp_10.42.42.5(pid=14949): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14949)] 05:56:43.889201 run osmo-stp_10.42.42.5(pid=14949): stdout: | (launched: 2022-12-14_05:56:42.456131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:44.028522 run osmo-stp_10.42.42.5(pid=14949): stderr: | 20221214055642649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055642649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055642650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055642650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055642650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055642650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055642650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:44.165507 run osmo-stp_10.42.42.5(pid=14949): stdout: | (launched: 2022-12-14_05:56:42.456131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:44.295745 run osmo-stp_10.42.42.5(pid=14949): stderr: | 20221214055642649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055642649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055642650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055642650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055642650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055642650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055642650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:44.452006 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14949): Process ended prematurely: osmo-stp_10.42.42.5(pid=14949) [trial-2400↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14949)] [trial-2400↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 05:56:44.461322 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 05:56:44.488938 run osmo-hlr_10.42.42.2(pid=14946): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14946)] 05:56:44.539676 run osmo-hlr_10.42.42.2(pid=14946): stdout: | (launched: 2022-12-14_05:56:41.435301) 05:56:44.591862 run osmo-hlr_10.42.42.2(pid=14946): stderr: | 20221214055641635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055641635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055641635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055641635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055641635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055641635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055641669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055641678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055641678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055641678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:44.665067 run osmo-msc_10.42.42.6(pid=14952): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14952)] 05:56:44.715428 run osmo-msc_10.42.42.6(pid=14952): stdout: | (launched: 2022-12-14_05:56:43.505618) 05:56:44.767534 run osmo-msc_10.42.42.6(pid=14952): stderr: | 20221214055643828 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055643828 DLGLOBAL DEBUG validating counter group 0x7fac72f65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055643829 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055643829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055643829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055643829 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055643831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055643831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055643831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055643831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:44.820298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14945): Terminating (SIGTERM) 05:56:44.862594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14948): Terminating (SIGTERM) 05:56:44.904809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14951): Terminating (SIGTERM) 05:56:44.947877 --- ParallelTerminationStrategy: PID 14945 died... 05:56:44.968348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14945): Terminated: ok {rc=0} 05:56:45.015503 --- ParallelTerminationStrategy: PID 14948 died... 05:56:45.035411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14948): Terminated: ok {rc=0} 05:56:45.082048 --- ParallelTerminationStrategy: PID 14951 died... 05:56:45.102042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14951): Terminated: ok {rc=0} 05:56:45.190339 bus /sierra_3: Setting Powered False 05:56:46.295402 bus /sierra_3: Setting Powered False 05:56:47.423207 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:48.657797 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:48.662047 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:48.697108 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 05:56:48.704392 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 05:56:48.742202 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:48.777272 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 05:56:48.784200 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 05:56:49.307466 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 05:56:49.314088 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 05:56:49.326277 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:49.390294 tst assert_extension.py: using LAC 38872 05:56:49.521132 tst assert_extension.py: using RAC 112 05:56:49.651969 tst assert_extension.py: using CellId 38872 05:56:49.783829 tst assert_extension.py: using BVCI 38873 05:56:49.905642 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 05:56:50.021539 tst assert_extension.py:10: start nitb and bts... 05:56:50.230515 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:56:50.864545 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14958): Launched 05:56:51.174602 run osmo-nitb_10.42.42.2(pid=14959): Launched 05:56:51.346252 run osmo-nitb_10.42.42.2(pid=14959): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14959)] 05:56:51.484806 run osmo-nitb_10.42.42.2(pid=14959): stdout: | (launched: 2022-12-14_05:56:51.117399) 05:56:51.625995 run osmo-nitb_10.42.42.2(pid=14959): stderr: | (launched: 2022-12-14_05:56:51.163042) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:51.766392 run osmo-nitb_10.42.42.2(pid=14959): stdout: | (launched: 2022-12-14_05:56:51.117399) 05:56:51.901221 run osmo-nitb_10.42.42.2(pid=14959): stderr: | (launched: 2022-12-14_05:56:51.163042) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14959): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14959) [trial-2400↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14959)] 05:56:52.291654 tst osmo-nitb_10.42.42.2(pid=14959): stdout: | (launched: 2022-12-14_05:56:51.117399) 05:56:52.417352 tst osmo-nitb_10.42.42.2(pid=14959): stderr: | (launched: 2022-12-14_05:56:51.163042) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:52.564720 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14959): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14959) [trial-2400↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14959)] [trial-2400↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 05:56:52.573426 tst assert_extension.py:12: Test FAILED (3.3 sec) 05:56:52.580134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14958): Terminating (SIGTERM) 05:56:52.790136 --- ParallelTerminationStrategy: PID 14958 died... 05:56:52.811596 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14958): Terminated: ok {rc=0} 05:56:52.898985 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:54.083912 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:54.087969 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:54.121202 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:56:54.149160 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 05:56:54.182674 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:54.216357 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:56:54.243075 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 05:56:54.779572 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 05:56:54.785076 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:54.796493 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:54.850011 tst assert_extension.py: using LAC 38873 05:56:54.978991 tst assert_extension.py: using RAC 113 05:56:55.101372 tst assert_extension.py: using CellId 38873 05:56:55.229314 tst assert_extension.py: using BVCI 38874 05:56:55.341737 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:55.352585 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:55.363293 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:55.373927 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:55.384797 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:55.396147 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 05:56:55.509458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:55.989186 run create_hlr_db(pid=14963): Launched 05:56:56.107128 bus /sierra_2: Setting Powered False 05:56:57.169175 run create_hlr_db(pid=14963): Terminated: ok {rc=0} 05:56:57.619950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14965): Launched 05:56:57.950399 run osmo-hlr_10.42.42.2(pid=14966): Launched 05:56:58.076300 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:58.734466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14968): Launched 05:56:59.058796 run osmo-stp_10.42.42.5(pid=14969): Launched 05:56:59.182452 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:59.768634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14971): Launched 05:57:00.093124 run osmo-msc_10.42.42.6(pid=14972): Launched 05:57:00.274232 run osmo-stp_10.42.42.5(pid=14969): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14969)] 05:57:00.411740 run osmo-stp_10.42.42.5(pid=14969): stdout: | (launched: 2022-12-14_05:56:58.999363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:00.548846 run osmo-stp_10.42.42.5(pid=14969): stderr: | 20221214055659191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055659191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055659191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055659192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055659192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055659192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055659192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:00.685606 run osmo-stp_10.42.42.5(pid=14969): stdout: | (launched: 2022-12-14_05:56:58.999363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:00.815059 run osmo-stp_10.42.42.5(pid=14969): stderr: | 20221214055659191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055659191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055659191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055659192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055659192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055659192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055659192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:00.978422 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14969): Process ended prematurely: osmo-stp_10.42.42.5(pid=14969) [trial-2400↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14969)] [trial-2400↪ussd:trx-sysmocell5000↪assert_extension.py:17] 05:57:00.988245 tst assert_extension.py:17: Test FAILED (6.2 sec) 05:57:01.016544 run osmo-hlr_10.42.42.2(pid=14966): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14966)] 05:57:01.070057 run osmo-hlr_10.42.42.2(pid=14966): stdout: | (launched: 2022-12-14_05:56:57.890306) 05:57:01.121173 run osmo-hlr_10.42.42.2(pid=14966): stderr: | 20221214055658089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055658089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055658089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055658089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055658089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055658089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055658107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055658117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055658117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055658117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:01.195825 run osmo-msc_10.42.42.6(pid=14972): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14972)] 05:57:01.246037 run osmo-msc_10.42.42.6(pid=14972): stdout: | (launched: 2022-12-14_05:57:00.033528) 05:57:01.299703 run osmo-msc_10.42.42.6(pid=14972): stderr: | 20221214055700355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055700355 DLGLOBAL DEBUG validating counter group 0x7ff20b259c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055700355 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055700355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055700355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055700355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055700357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055700358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055700358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055700358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:01.353621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14965): Terminating (SIGTERM) 05:57:01.395652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14968): Terminating (SIGTERM) 05:57:01.441360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14971): Terminating (SIGTERM) 05:57:01.484618 --- ParallelTerminationStrategy: PID 14965 died... 05:57:01.506966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14965): Terminated: ok {rc=0} 05:57:01.555265 --- ParallelTerminationStrategy: PID 14968 died... 05:57:01.576416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14968): Terminated: ok {rc=0} 05:57:01.624122 --- ParallelTerminationStrategy: PID 14971 died... 05:57:01.644777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14971): Terminated: ok {rc=0} 05:57:01.734257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:57:02.943229 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:02.949712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:57:02.982717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:57:03.013665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:57:03.067635 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:57:03.102180 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:57:03.129725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:57:03.681877 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:57:03.737104 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:03.748778 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:57:03.822392 tst mo_mt_call.py: using LAC 38874 05:57:03.953186 tst mo_mt_call.py: using RAC 114 05:57:04.084151 tst mo_mt_call.py: using CellId 38874 05:57:04.215425 tst mo_mt_call.py: using BVCI 38875 05:57:04.335342 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:04.347055 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:04.358591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:04.370120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:04.381748 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:04.393256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:57:04.509919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:57:04.626246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:05.107746 run create_hlr_db(pid=14977): Launched 05:57:05.226718 bus /sierra_2: Setting Powered False 05:57:06.288506 run create_hlr_db(pid=14977): Terminated: ok {rc=0} 05:57:06.721908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14979): Launched 05:57:07.032533 run osmo-hlr_10.42.42.2(pid=14980): Launched 05:57:07.151103 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:07.701344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14982): Launched 05:57:08.011900 run osmo-stp_10.42.42.5(pid=14983): Launched 05:57:08.130959 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:08.694107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14985): Launched 05:57:09.005495 run osmo-msc_10.42.42.6(pid=14986): Launched 05:57:09.179045 run osmo-stp_10.42.42.5(pid=14983): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14983)] 05:57:09.310996 run osmo-stp_10.42.42.5(pid=14983): stdout: | (launched: 2022-12-14_05:57:07.955211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:09.443084 run osmo-stp_10.42.42.5(pid=14983): stderr: | 20221214055708126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055708126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055708127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055708127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055708127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055708127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055708128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:09.572292 run osmo-stp_10.42.42.5(pid=14983): stdout: | (launched: 2022-12-14_05:57:07.955211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:09.695925 run osmo-stp_10.42.42.5(pid=14983): stderr: | 20221214055708126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055708126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055708127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055708127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055708127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055708127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055708128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:09.844346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14983): Process ended prematurely: osmo-stp_10.42.42.5(pid=14983) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14983)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:57:09.853647 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:57:09.880066 run osmo-hlr_10.42.42.2(pid=14980): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14980)] 05:57:09.928683 run osmo-hlr_10.42.42.2(pid=14980): stdout: | (launched: 2022-12-14_05:57:06.975791) 05:57:09.978727 run osmo-hlr_10.42.42.2(pid=14980): stderr: | 20221214055707152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055707152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055707152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055707152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055707152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055707152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055707164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055707172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055707172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055707172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:10.048686 run osmo-msc_10.42.42.6(pid=14986): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14986)] 05:57:10.096798 run osmo-msc_10.42.42.6(pid=14986): stdout: | (launched: 2022-12-14_05:57:08.948602) 05:57:10.146862 run osmo-msc_10.42.42.6(pid=14986): stderr: | 20221214055709220 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055709220 DLGLOBAL DEBUG validating counter group 0x7f9eba8a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055709220 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055709220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055709220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055709220 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055709222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055709223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055709223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055709223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:10.197486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14979): Terminating (SIGTERM) 05:57:10.237963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14982): Terminating (SIGTERM) 05:57:10.278473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14985): Terminating (SIGTERM) 05:57:10.319193 --- ParallelTerminationStrategy: PID 14979 died... 05:57:10.338965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14979): Terminated: ok {rc=0} 05:57:10.383471 --- ParallelTerminationStrategy: PID 14982 died... 05:57:10.402514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14982): Terminated: ok {rc=0} 05:57:10.446748 --- ParallelTerminationStrategy: PID 14985 died... 05:57:10.465908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14985): Terminated: ok {rc=0} 05:57:10.552518 bus /sierra_3: Setting Powered False 05:57:11.652601 bus /sierra_3: Setting Powered False 05:57:12.768902 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:57:13.920040 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:13.932480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:57:14.004396 tst mo_mt_call_osmux.py: using LAC 38875 05:57:14.135635 tst mo_mt_call_osmux.py: using RAC 115 05:57:14.266992 tst mo_mt_call_osmux.py: using CellId 38875 05:57:14.396230 tst mo_mt_call_osmux.py: using BVCI 38876 05:57:14.517747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:14.529489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:14.540930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:14.552434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:14.564054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:57:14.575472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:57:14.696935 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:57:14.817566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:15.332826 run create_hlr_db(pid=14988): Launched 05:57:15.466614 bus /sierra_2: Setting Powered False 05:57:16.531469 run create_hlr_db(pid=14988): Terminated: ok {rc=0} 05:57:17.005619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14990): Launched 05:57:17.349149 run osmo-hlr_10.42.42.2(pid=14991): Launched 05:57:17.475731 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:18.053962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14993): Launched 05:57:18.386193 run osmo-stp_10.42.42.5(pid=14994): Launched 05:57:18.518164 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:19.122324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14996): Launched 05:57:19.454187 run osmo-msc_10.42.42.6(pid=14997): Launched 05:57:19.638897 run osmo-stp_10.42.42.5(pid=14994): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14994)] 05:57:19.779455 run osmo-stp_10.42.42.5(pid=14994): stdout: | (launched: 2022-12-14_05:57:18.326031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:19.920389 run osmo-stp_10.42.42.5(pid=14994): stderr: | 20221214055718518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055718518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055718518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055718519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055718519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055718519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055718519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:20.059155 run osmo-stp_10.42.42.5(pid=14994): stdout: | (launched: 2022-12-14_05:57:18.326031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:20.191537 run osmo-stp_10.42.42.5(pid=14994): stderr: | 20221214055718518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055718518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055718518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055718519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055718519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055718519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055718519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:20.349810 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14994): Process ended prematurely: osmo-stp_10.42.42.5(pid=14994) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14994)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:57:20.359569 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:57:20.387203 run osmo-hlr_10.42.42.2(pid=14991): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14991)] 05:57:20.437808 run osmo-hlr_10.42.42.2(pid=14991): stdout: | (launched: 2022-12-14_05:57:17.288585) 05:57:20.489754 run osmo-hlr_10.42.42.2(pid=14991): stderr: | 20221214055717487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055717487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055717487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055717488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055717488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055717488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055717500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055717509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055717510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055717510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:20.561983 run osmo-msc_10.42.42.6(pid=14997): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14997)] 05:57:20.611863 run osmo-msc_10.42.42.6(pid=14997): stdout: | (launched: 2022-12-14_05:57:19.393960) 05:57:20.663821 run osmo-msc_10.42.42.6(pid=14997): stderr: | 20221214055719718 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055719718 DLGLOBAL DEBUG validating counter group 0x7febda42ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055719718 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055719718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055719718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055719718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055719720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055719720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055719721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055719721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:20.715968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14990): Terminating (SIGTERM) 05:57:20.757812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14993): Terminating (SIGTERM) 05:57:20.799521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14996): Terminating (SIGTERM) 05:57:20.841788 --- ParallelTerminationStrategy: PID 14990 died... 05:57:20.861862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14990): Terminated: ok {rc=0} 05:57:20.908336 --- ParallelTerminationStrategy: PID 14993 died... 05:57:20.927853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14993): Terminated: ok {rc=0} 05:57:20.974146 --- ParallelTerminationStrategy: PID 14996 died... 05:57:20.993745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14996): Terminated: ok {rc=0} 05:57:21.082007 bus /sierra_3: Setting Powered False 05:57:22.180683 bus /sierra_3: Setting Powered False 05:57:23.297481 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:57:24.557540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:24.565046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:57:24.599612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:57:24.627220 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:57:24.679812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:57:24.715573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:57:24.743275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:57:25.291981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:57:25.342659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:25.354115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:57:25.427328 tst mo_mt_call.py: using LAC 38876 05:57:25.548402 tst mo_mt_call.py: using RAC 116 05:57:25.668536 tst mo_mt_call.py: using CellId 38876 05:57:25.788375 tst mo_mt_call.py: using BVCI 38877 05:57:25.901664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:25.913048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:25.924171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:25.935938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:25.947677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:25.959274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:57:26.080541 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:57:26.202275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:26.717159 run create_hlr_db(pid=15003): Launched 05:57:26.852581 bus /sierra_2: Setting Powered False 05:57:27.917527 run create_hlr_db(pid=15003): Terminated: ok {rc=0} 05:57:28.362524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15005): Launched 05:57:28.676483 run osmo-hlr_10.42.42.2(pid=15006): Launched 05:57:28.795333 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:29.345837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15008): Launched 05:57:29.657069 run osmo-stp_10.42.42.5(pid=15009): Launched 05:57:29.775269 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:30.345855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15011): Launched 05:57:30.657670 run osmo-msc_10.42.42.6(pid=15012): Launched 05:57:30.844241 run osmo-stp_10.42.42.5(pid=15009): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15009)] 05:57:31.119501 run osmo-stp_10.42.42.5(pid=15009): stdout: | (launched: 2022-12-14_05:57:29.600167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:31.262293 run osmo-stp_10.42.42.5(pid=15009): stderr: | 20221214055729772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055729773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055729773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055729773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055729774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055729774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055729774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:31.405941 run osmo-stp_10.42.42.5(pid=15009): stdout: | (launched: 2022-12-14_05:57:29.600167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:31.541086 run osmo-stp_10.42.42.5(pid=15009): stderr: | 20221214055729772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055729773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055729773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055729773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055729774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055729774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055729774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:31.707582 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15009): Process ended prematurely: osmo-stp_10.42.42.5(pid=15009) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15009)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:57:31.718501 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:57:31.747992 run osmo-hlr_10.42.42.2(pid=15006): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15006)] 05:57:31.801243 run osmo-hlr_10.42.42.2(pid=15006): stdout: | (launched: 2022-12-14_05:57:28.619424) 05:57:31.855266 run osmo-hlr_10.42.42.2(pid=15006): stderr: | 20221214055728799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055728800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055728800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055728800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055728800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055728800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055728812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055728821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055728821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055728821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:31.930308 run osmo-msc_10.42.42.6(pid=15012): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15012)] 05:57:31.983436 run osmo-msc_10.42.42.6(pid=15012): stdout: | (launched: 2022-12-14_05:57:30.600706) 05:57:32.038200 run osmo-msc_10.42.42.6(pid=15012): stderr: | 20221214055730882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055730882 DLGLOBAL DEBUG validating counter group 0x7f8094360c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055730882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055730882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055730882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055730882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055730884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055730893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055730893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055730893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:32.092869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15005): Terminating (SIGTERM) 05:57:32.136607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15008): Terminating (SIGTERM) 05:57:32.182999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15011): Terminating (SIGTERM) 05:57:32.229331 --- ParallelTerminationStrategy: PID 15005 died... 05:57:32.251753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15005): Terminated: ok {rc=0} 05:57:32.298749 --- ParallelTerminationStrategy: PID 15008 died... 05:57:32.318555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15008): Terminated: ok {rc=0} 05:57:32.365038 --- ParallelTerminationStrategy: PID 15011 died... 05:57:32.384894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15011): Terminated: ok {rc=0} 05:57:32.473039 bus /sierra_3: Setting Powered False 05:57:33.572060 bus /sierra_3: Setting Powered False 05:57:34.687435 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:57:35.831895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:35.844021 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:57:35.914351 tst mo_mt_call_osmux.py: using LAC 38877 05:57:36.038266 tst mo_mt_call_osmux.py: using RAC 117 05:57:36.160360 tst mo_mt_call_osmux.py: using CellId 38877 05:57:36.284147 tst mo_mt_call_osmux.py: using BVCI 38878 05:57:36.398788 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:36.410144 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:36.421313 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:36.432189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:36.443644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:36.455185 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:57:36.571784 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:57:36.694913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:37.210129 run create_hlr_db(pid=15014): Launched 05:57:37.344389 bus /sierra_2: Setting Powered False 05:57:38.409539 run create_hlr_db(pid=15014): Terminated: ok {rc=0} 05:57:38.852038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15016): Launched 05:57:39.164438 run osmo-hlr_10.42.42.2(pid=15017): Launched 05:57:39.283671 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:39.833870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15019): Launched 05:57:40.148866 run osmo-stp_10.42.42.5(pid=15020): Launched 05:57:40.271540 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:40.836809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15022): Launched 05:57:41.150367 run osmo-msc_10.42.42.6(pid=15023): Launched 05:57:41.326386 run osmo-stp_10.42.42.5(pid=15020): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15020)] 05:57:41.458664 run osmo-stp_10.42.42.5(pid=15020): stdout: | (launched: 2022-12-14_05:57:40.091826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:41.590480 run osmo-stp_10.42.42.5(pid=15020): stderr: | 20221214055740264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055740264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055740264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055740265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055740267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055740267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055740267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:41.720553 run osmo-stp_10.42.42.5(pid=15020): stdout: | (launched: 2022-12-14_05:57:40.091826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:41.844752 run osmo-stp_10.42.42.5(pid=15020): stderr: | 20221214055740264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055740264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055740264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055740265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055740267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055740267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055740267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:41.993676 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15020): Process ended prematurely: osmo-stp_10.42.42.5(pid=15020) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15020)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:57:42.003261 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:57:42.029797 run osmo-hlr_10.42.42.2(pid=15017): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15017)] 05:57:42.077920 run osmo-hlr_10.42.42.2(pid=15017): stdout: | (launched: 2022-12-14_05:57:39.107652) 05:57:42.127543 run osmo-hlr_10.42.42.2(pid=15017): stderr: | 20221214055739288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055739288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055739289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055739289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055739289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055739289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055739300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055739310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055739310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055739310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:42.196682 run osmo-msc_10.42.42.6(pid=15023): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15023)] 05:57:42.244180 run osmo-msc_10.42.42.6(pid=15023): stdout: | (launched: 2022-12-14_05:57:41.093186) 05:57:42.293712 run osmo-msc_10.42.42.6(pid=15023): stderr: | 20221214055741367 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055741367 DLGLOBAL DEBUG validating counter group 0x7f5609a71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055741367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055741367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055741368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055741368 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055741371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055741372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055741372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055741372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:42.343477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15016): Terminating (SIGTERM) 05:57:42.383618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15019): Terminating (SIGTERM) 05:57:42.424210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15022): Terminating (SIGTERM) 05:57:42.464436 --- ParallelTerminationStrategy: PID 15016 died... 05:57:42.483881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15016): Terminated: ok {rc=0} 05:57:42.528116 --- ParallelTerminationStrategy: PID 15019 died... 05:57:42.547051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15019): Terminated: ok {rc=0} 05:57:42.590906 --- ParallelTerminationStrategy: PID 15022 died... 05:57:42.609768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15022): Terminated: ok {rc=0} 05:57:42.692442 bus /sierra_3: Setting Powered False 05:57:43.789978 bus /sierra_3: Setting Powered False 05:57:44.906138 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:57:46.164713 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:46.173492 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:57:46.217607 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:57:46.249991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:57:46.313175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:57:46.367361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:57:46.401565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:57:46.960037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:57:47.019945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:47.032373 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:57:47.109235 tst mo_mt_call.py: using LAC 38878 05:57:47.255996 tst mo_mt_call.py: using RAC 118 05:57:47.387939 tst mo_mt_call.py: using CellId 38878 05:57:47.519416 tst mo_mt_call.py: using BVCI 38879 05:57:47.641855 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:47.653876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:47.665996 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:47.677746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:47.689542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:47.701303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:47.821960 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:47.938703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:48.424224 run create_hlr_db(pid=15028): Launched 05:57:48.544445 bus /sierra_2: Setting Powered False 05:57:49.606660 run create_hlr_db(pid=15028): Terminated: ok {rc=0} 05:57:50.041960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15030): Launched 05:57:50.354770 run osmo-hlr_10.42.42.2(pid=15031): Launched 05:57:50.473255 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:51.024677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15033): Launched 05:57:51.336744 run osmo-stp_10.42.42.5(pid=15034): Launched 05:57:51.455746 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:52.021195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15036): Launched 05:57:52.334587 run osmo-msc_10.42.42.6(pid=15037): Launched 05:57:52.509586 run osmo-stp_10.42.42.5(pid=15034): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15034)] 05:57:52.641998 run osmo-stp_10.42.42.5(pid=15034): stdout: | (launched: 2022-12-14_05:57:51.279845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:52.774731 run osmo-stp_10.42.42.5(pid=15034): stderr: | 20221214055751451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055751451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055751451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055751452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055751452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055751452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055751452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:52.904824 run osmo-stp_10.42.42.5(pid=15034): stdout: | (launched: 2022-12-14_05:57:51.279845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:53.028755 run osmo-stp_10.42.42.5(pid=15034): stderr: | 20221214055751451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055751451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055751451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055751452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055751452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055751452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055751452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:53.177502 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15034): Process ended prematurely: osmo-stp_10.42.42.5(pid=15034) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15034)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:57:53.186564 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:57:53.213078 run osmo-hlr_10.42.42.2(pid=15031): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15031)] 05:57:53.261406 run osmo-hlr_10.42.42.2(pid=15031): stdout: | (launched: 2022-12-14_05:57:50.297809) 05:57:53.311148 run osmo-hlr_10.42.42.2(pid=15031): stderr: | 20221214055750475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055750475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055750475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055750475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055750475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055750475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055750487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055750495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055750496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055750496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:53.380904 run osmo-msc_10.42.42.6(pid=15037): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15037)] 05:57:53.428651 run osmo-msc_10.42.42.6(pid=15037): stdout: | (launched: 2022-12-14_05:57:52.277472) 05:57:53.478386 run osmo-msc_10.42.42.6(pid=15037): stderr: | 20221214055752550 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055752550 DLGLOBAL DEBUG validating counter group 0x7f1f7d893c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055752550 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055752550 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055752550 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055752550 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055752554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055752554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055752554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055752554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:53.528206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15030): Terminating (SIGTERM) 05:57:53.568244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15033): Terminating (SIGTERM) 05:57:53.608281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15036): Terminating (SIGTERM) 05:57:53.648486 --- ParallelTerminationStrategy: PID 15030 died... 05:57:53.667976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15030): Terminated: ok {rc=0} 05:57:53.712262 --- ParallelTerminationStrategy: PID 15033 died... 05:57:53.731134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15033): Terminated: ok {rc=0} 05:57:53.775165 --- ParallelTerminationStrategy: PID 15036 died... 05:57:53.794110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15036): Terminated: ok {rc=0} 05:57:53.877822 bus /sierra_3: Setting Powered False 05:57:54.977050 bus /sierra_3: Setting Powered False 05:57:56.094290 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:57:57.246235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:57.258800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:57:57.332484 tst mo_mt_call_osmux.py: using LAC 38879 05:57:57.455204 tst mo_mt_call_osmux.py: using RAC 119 05:57:57.583060 tst mo_mt_call_osmux.py: using CellId 38879 05:57:57.705942 tst mo_mt_call_osmux.py: using BVCI 38880 05:57:57.821495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:57.832917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:57.844231 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:57.855292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:57.866735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:57.878090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:57.999012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:58.118230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:58.605116 run create_hlr_db(pid=15039): Launched 05:57:58.724804 bus /sierra_2: Setting Powered False 05:57:59.786980 run create_hlr_db(pid=15039): Terminated: ok {rc=0} 05:58:00.223191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15041): Launched 05:58:00.537924 run osmo-hlr_10.42.42.2(pid=15042): Launched 05:58:00.657485 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:01.239924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15044): Launched 05:58:01.589709 run osmo-stp_10.42.42.5(pid=15045): Launched 05:58:01.915377 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:02.515896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15047): Launched 05:58:02.829378 run osmo-msc_10.42.42.6(pid=15048): Launched 05:58:03.004038 run osmo-stp_10.42.42.5(pid=15045): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15045)] 05:58:03.136809 run osmo-stp_10.42.42.5(pid=15045): stdout: | (launched: 2022-12-14_05:58:01.531672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:03.268851 run osmo-stp_10.42.42.5(pid=15045): stderr: | 20221214055801757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055801757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055801757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055801758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055801758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055801758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055801758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:03.398790 run osmo-stp_10.42.42.5(pid=15045): stdout: | (launched: 2022-12-14_05:58:01.531672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:03.522734 run osmo-stp_10.42.42.5(pid=15045): stderr: | 20221214055801757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055801757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055801757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055801758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055801758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055801758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055801758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:03.671244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15045): Process ended prematurely: osmo-stp_10.42.42.5(pid=15045) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15045)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:58:03.680479 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:58:03.706736 run osmo-hlr_10.42.42.2(pid=15042): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15042)] 05:58:03.754791 run osmo-hlr_10.42.42.2(pid=15042): stdout: | (launched: 2022-12-14_05:58:00.480761) 05:58:03.804493 run osmo-hlr_10.42.42.2(pid=15042): stderr: | 20221214055800660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055800660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055800660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055800660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055800660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055800660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055800672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055800680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055800681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055800681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:03.873913 run osmo-msc_10.42.42.6(pid=15048): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15048)] 05:58:03.921439 run osmo-msc_10.42.42.6(pid=15048): stdout: | (launched: 2022-12-14_05:58:02.772297) 05:58:03.970761 run osmo-msc_10.42.42.6(pid=15048): stderr: | 20221214055803046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055803046 DLGLOBAL DEBUG validating counter group 0x7f2570059c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055803046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055803046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055803046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055803047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055803048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055803049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055803049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055803049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:04.020766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15041): Terminating (SIGTERM) 05:58:04.060714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15044): Terminating (SIGTERM) 05:58:04.100829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15047): Terminating (SIGTERM) 05:58:04.141270 --- ParallelTerminationStrategy: PID 15041 died... 05:58:04.160751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15041): Terminated: ok {rc=0} 05:58:04.205330 --- ParallelTerminationStrategy: PID 15044 died... 05:58:04.224280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15044): Terminated: ok {rc=0} 05:58:04.268229 --- ParallelTerminationStrategy: PID 15047 died... 05:58:04.287293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15047): Terminated: ok {rc=0} 05:58:04.374125 bus /sierra_3: Setting Powered False 05:58:05.473149 bus /sierra_3: Setting Powered False 05:58:06.585164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:58:07.845715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:07.853136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:58:07.887615 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:58:07.915544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:58:07.966910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:58:08.001580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:58:08.028804 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:58:08.587580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:58:08.640838 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:08.652612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:58:08.722639 tst mo_mt_call.py: using LAC 38880 05:58:08.855244 tst mo_mt_call.py: using RAC 120 05:58:08.983542 tst mo_mt_call.py: using CellId 38880 05:58:09.111239 tst mo_mt_call.py: using BVCI 38881 05:58:09.231379 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:09.243055 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:09.254586 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:09.266098 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:09.277807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:09.289287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:58:09.407266 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:58:09.529047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:10.042939 run create_hlr_db(pid=15054): Launched 05:58:10.179230 bus /sierra_2: Setting Powered False 05:58:11.244353 run create_hlr_db(pid=15054): Terminated: ok {rc=0} 05:58:11.705935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15056): Launched 05:58:12.038578 run osmo-hlr_10.42.42.2(pid=15057): Launched 05:58:12.166048 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:12.739034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15059): Launched 05:58:13.072873 run osmo-stp_10.42.42.5(pid=15060): Launched 05:58:13.200146 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:13.802112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15062): Launched 05:58:14.136343 run osmo-msc_10.42.42.6(pid=15063): Launched 05:58:14.322887 run osmo-stp_10.42.42.5(pid=15060): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15060)] 05:58:14.462782 run osmo-stp_10.42.42.5(pid=15060): stdout: | (launched: 2022-12-14_05:58:13.012654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:14.603237 run osmo-stp_10.42.42.5(pid=15060): stderr: | 20221214055813207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055813207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055813208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055813209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055813209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055813209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055813209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:14.742689 run osmo-stp_10.42.42.5(pid=15060): stdout: | (launched: 2022-12-14_05:58:13.012654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:14.874540 run osmo-stp_10.42.42.5(pid=15060): stderr: | 20221214055813207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055813207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055813208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055813209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055813209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055813209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055813209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:15.032463 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15060): Process ended prematurely: osmo-stp_10.42.42.5(pid=15060) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15060)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:58:15.042148 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:58:15.069851 run osmo-hlr_10.42.42.2(pid=15057): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15057)] 05:58:15.119817 run osmo-hlr_10.42.42.2(pid=15057): stdout: | (launched: 2022-12-14_05:58:11.978220) 05:58:15.171454 run osmo-hlr_10.42.42.2(pid=15057): stderr: | 20221214055812177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055812177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055812177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055812177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055812177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055812177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055812189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055812199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055812199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055812199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:15.243822 run osmo-msc_10.42.42.6(pid=15063): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15063)] 05:58:15.293671 run osmo-msc_10.42.42.6(pid=15063): stdout: | (launched: 2022-12-14_05:58:14.075788) 05:58:15.345416 run osmo-msc_10.42.42.6(pid=15063): stderr: | 20221214055814401 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055814401 DLGLOBAL DEBUG validating counter group 0x7efc9133ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055814401 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055814401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055814402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055814402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055814403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055814404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055814404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055814404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:15.397400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15056): Terminating (SIGTERM) 05:58:15.438936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15059): Terminating (SIGTERM) 05:58:15.480702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15062): Terminating (SIGTERM) 05:58:15.523143 --- ParallelTerminationStrategy: PID 15056 died... 05:58:15.543079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15056): Terminated: ok {rc=0} 05:58:15.589143 --- ParallelTerminationStrategy: PID 15059 died... 05:58:15.608426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15059): Terminated: ok {rc=0} 05:58:15.654381 --- ParallelTerminationStrategy: PID 15062 died... 05:58:15.674095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15062): Terminated: ok {rc=0} 05:58:15.762191 bus /sierra_3: Setting Powered False 05:58:16.857810 bus /sierra_3: Setting Powered False 05:58:17.972549 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:58:19.123034 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:19.135488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:58:19.207711 tst mo_mt_call_osmux.py: using LAC 38881 05:58:19.331371 tst mo_mt_call_osmux.py: using RAC 121 05:58:19.454574 tst mo_mt_call_osmux.py: using CellId 38881 05:58:19.578252 tst mo_mt_call_osmux.py: using BVCI 38882 05:58:19.693611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:19.705073 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:19.716000 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:19.727091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:19.738556 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:58:19.749927 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:58:19.871069 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:58:19.990002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:20.476333 run create_hlr_db(pid=15065): Launched 05:58:20.595418 bus /sierra_2: Setting Powered False 05:58:21.657360 run create_hlr_db(pid=15065): Terminated: ok {rc=0} 05:58:22.113882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15067): Launched 05:58:22.448487 run osmo-hlr_10.42.42.2(pid=15068): Launched 05:58:22.576572 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:23.154438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15070): Launched 05:58:23.489058 run osmo-stp_10.42.42.5(pid=15071): Launched 05:58:23.615631 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:24.218142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15073): Launched 05:58:24.551143 run osmo-msc_10.42.42.6(pid=15074): Launched 05:58:24.736405 run osmo-stp_10.42.42.5(pid=15071): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15071)] 05:58:24.875465 run osmo-stp_10.42.42.5(pid=15071): stdout: | (launched: 2022-12-14_05:58:23.427904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:25.015726 run osmo-stp_10.42.42.5(pid=15071): stderr: | 20221214055823623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055823624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055823624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055823624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055823626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055823627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055823627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:25.154652 run osmo-stp_10.42.42.5(pid=15071): stdout: | (launched: 2022-12-14_05:58:23.427904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:25.287370 run osmo-stp_10.42.42.5(pid=15071): stderr: | 20221214055823623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055823624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055823624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055823624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055823626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055823627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055823627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:25.445655 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15071): Process ended prematurely: osmo-stp_10.42.42.5(pid=15071) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15071)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:58:25.455365 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:58:25.482872 run osmo-hlr_10.42.42.2(pid=15068): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15068)] 05:58:25.532653 run osmo-hlr_10.42.42.2(pid=15068): stdout: | (launched: 2022-12-14_05:58:22.387716) 05:58:25.584496 run osmo-hlr_10.42.42.2(pid=15068): stderr: | 20221214055822586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055822586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055822586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055822586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055822587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055822587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055822599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055822608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055822608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055822608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:25.656433 run osmo-msc_10.42.42.6(pid=15074): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15074)] 05:58:25.706591 run osmo-msc_10.42.42.6(pid=15074): stdout: | (launched: 2022-12-14_05:58:24.490175) 05:58:25.758297 run osmo-msc_10.42.42.6(pid=15074): stderr: | 20221214055824816 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055824816 DLGLOBAL DEBUG validating counter group 0x7fa9eb14fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055824816 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055824816 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055824816 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055824816 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055824818 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055824818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055824819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055824819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:25.810532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15067): Terminating (SIGTERM) 05:58:25.851961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15070): Terminating (SIGTERM) 05:58:25.893926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15073): Terminating (SIGTERM) 05:58:25.936095 --- ParallelTerminationStrategy: PID 15067 died... 05:58:25.955921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15067): Terminated: ok {rc=0} 05:58:26.001896 --- ParallelTerminationStrategy: PID 15070 died... 05:58:26.021221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15070): Terminated: ok {rc=0} 05:58:26.067153 --- ParallelTerminationStrategy: PID 15073 died... 05:58:26.086660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15073): Terminated: ok {rc=0} 05:58:26.174026 bus /sierra_3: Setting Powered False 05:58:27.273624 bus /sierra_3: Setting Powered False 05:58:28.391817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:58:29.642472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:29.649080 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:58:29.682296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:58:29.709705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:58:29.762100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:58:29.797524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:58:29.826495 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:58:30.372036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:58:30.424212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:30.435645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:58:30.508353 tst mo_mt_call.py: using LAC 38882 05:58:30.639943 tst mo_mt_call.py: using RAC 122 05:58:30.770648 tst mo_mt_call.py: using CellId 38882 05:58:30.921469 tst mo_mt_call.py: using BVCI 38883 05:58:31.049866 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:31.062421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:31.074770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:31.087234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:31.100803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:31.114445 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:58:31.249509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:58:31.369414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:31.881886 run create_hlr_db(pid=15079): Launched 05:58:32.040756 bus /sierra_2: Setting Powered False 05:58:33.102579 run create_hlr_db(pid=15079): Terminated: ok {rc=0} 05:58:33.559711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15081): Launched 05:58:33.894249 run osmo-hlr_10.42.42.2(pid=15082): Launched 05:58:34.021848 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:34.594438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15084): Launched 05:58:34.927359 run osmo-stp_10.42.42.5(pid=15085): Launched 05:58:35.053445 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:35.656569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15087): Launched 05:58:35.990464 run osmo-msc_10.42.42.6(pid=15088): Launched 05:58:36.177226 run osmo-stp_10.42.42.5(pid=15085): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15085)] 05:58:36.317638 run osmo-stp_10.42.42.5(pid=15085): stdout: | (launched: 2022-12-14_05:58:34.866932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:36.459509 run osmo-stp_10.42.42.5(pid=15085): stderr: | 20221214055835063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055835063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055835063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055835063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055835064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055835064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055835064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:36.598631 run osmo-stp_10.42.42.5(pid=15085): stdout: | (launched: 2022-12-14_05:58:34.866932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:36.731415 run osmo-stp_10.42.42.5(pid=15085): stderr: | 20221214055835063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055835063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055835063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055835063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055835064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055835064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055835064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:36.889763 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15085): Process ended prematurely: osmo-stp_10.42.42.5(pid=15085) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15085)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:58:36.899336 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:58:36.926992 run osmo-hlr_10.42.42.2(pid=15082): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15082)] 05:58:36.976782 run osmo-hlr_10.42.42.2(pid=15082): stdout: | (launched: 2022-12-14_05:58:33.833710) 05:58:37.028504 run osmo-hlr_10.42.42.2(pid=15082): stderr: | 20221214055834033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055834033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055834033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055834033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055834033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055834033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055834058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055834067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055834067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055834068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:37.100592 run osmo-msc_10.42.42.6(pid=15088): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15088)] 05:58:37.150541 run osmo-msc_10.42.42.6(pid=15088): stdout: | (launched: 2022-12-14_05:58:35.929780) 05:58:37.202100 run osmo-msc_10.42.42.6(pid=15088): stderr: | 20221214055836254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055836254 DLGLOBAL DEBUG validating counter group 0x7fce2aaa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055836254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055836254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055836254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055836255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055836258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055836259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055836259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055836259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:37.253923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15081): Terminating (SIGTERM) 05:58:37.295747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15084): Terminating (SIGTERM) 05:58:37.337706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15087): Terminating (SIGTERM) 05:58:37.379756 --- ParallelTerminationStrategy: PID 15081 died... 05:58:37.399825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15081): Terminated: ok {rc=0} 05:58:37.445909 --- ParallelTerminationStrategy: PID 15084 died... 05:58:37.465346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15084): Terminated: ok {rc=0} 05:58:37.511291 --- ParallelTerminationStrategy: PID 15087 died... 05:58:37.530874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15087): Terminated: ok {rc=0} 05:58:37.620002 bus /sierra_3: Setting Powered False 05:58:38.720033 bus /sierra_3: Setting Powered False 05:58:39.836691 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:58:40.986839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:40.999487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:58:41.072472 tst mo_mt_call_osmux.py: using LAC 38883 05:58:41.203972 tst mo_mt_call_osmux.py: using RAC 123 05:58:41.333923 tst mo_mt_call_osmux.py: using CellId 38883 05:58:41.465520 tst mo_mt_call_osmux.py: using BVCI 38884 05:58:41.586123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:41.598161 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:41.610262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:41.621955 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:41.633787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:41.645482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:58:41.763191 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:58:41.885388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:42.402868 run create_hlr_db(pid=15090): Launched 05:58:42.538490 bus /sierra_2: Setting Powered False 05:58:43.603943 run create_hlr_db(pid=15090): Terminated: ok {rc=0} 05:58:44.050549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15092): Launched 05:58:44.365759 run osmo-hlr_10.42.42.2(pid=15093): Launched 05:58:44.485024 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:45.029031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15095): Launched 05:58:45.342941 run osmo-stp_10.42.42.5(pid=15096): Launched 05:58:45.462680 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:46.052913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15098): Launched 05:58:46.411701 run osmo-msc_10.42.42.6(pid=15099): Launched 05:58:46.797593 run osmo-stp_10.42.42.5(pid=15096): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15096)] 05:58:47.085872 run osmo-stp_10.42.42.5(pid=15096): stdout: | (launched: 2022-12-14_05:58:45.285617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:47.252420 run osmo-stp_10.42.42.5(pid=15096): stderr: | 20221214055845457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055845457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055845457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055845457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055845460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055845460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055845460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:47.391422 run osmo-stp_10.42.42.5(pid=15096): stdout: | (launched: 2022-12-14_05:58:45.285617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:47.523897 run osmo-stp_10.42.42.5(pid=15096): stderr: | 20221214055845457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055845457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055845457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055845457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055845460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055845460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055845460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:47.682909 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15096): Process ended prematurely: osmo-stp_10.42.42.5(pid=15096) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15096)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:58:47.693104 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 05:58:47.721188 run osmo-hlr_10.42.42.2(pid=15093): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15093)] 05:58:47.771880 run osmo-hlr_10.42.42.2(pid=15093): stdout: | (launched: 2022-12-14_05:58:44.308504) 05:58:47.824546 run osmo-hlr_10.42.42.2(pid=15093): stderr: | 20221214055844488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055844488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055844488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055844488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055844488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055844488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055844501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055844510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055844510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055844510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:47.897986 run osmo-msc_10.42.42.6(pid=15099): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15099)] 05:58:47.948497 run osmo-msc_10.42.42.6(pid=15099): stdout: | (launched: 2022-12-14_05:58:46.348073) 05:58:48.001084 run osmo-msc_10.42.42.6(pid=15099): stderr: | 20221214055846862 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055846862 DLGLOBAL DEBUG validating counter group 0x7fb17b3e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055846862 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055846863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055846863 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055846863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055846865 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055846865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055846865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055846865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:48.053794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15092): Terminating (SIGTERM) 05:58:48.095995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15095): Terminating (SIGTERM) 05:58:48.138669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15098): Terminating (SIGTERM) 05:58:48.181625 --- ParallelTerminationStrategy: PID 15092 died... 05:58:48.201967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15092): Terminated: ok {rc=0} 05:58:48.248453 --- ParallelTerminationStrategy: PID 15095 died... 05:58:48.268245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15095): Terminated: ok {rc=0} 05:58:48.314806 --- ParallelTerminationStrategy: PID 15098 died... 05:58:48.334764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15098): Terminated: ok {rc=0} 05:58:48.423039 bus /sierra_3: Setting Powered False 05:58:49.521081 bus /sierra_3: Setting Powered False 05:58:50.636295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:58:51.896912 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:51.904335 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:58:51.938846 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:58:51.966587 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:58:52.018930 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:58:52.053276 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:58:52.080330 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:58:52.634767 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:58:52.688397 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:52.700647 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:58:52.773216 tst mo_mt_call.py: using LAC 38884 05:58:52.903962 tst mo_mt_call.py: using RAC 124 05:58:53.037817 tst mo_mt_call.py: using CellId 38884 05:58:53.161064 tst mo_mt_call.py: using BVCI 38885 05:58:53.273959 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:53.285316 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:53.296332 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:53.307462 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:53.318862 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:53.330272 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:53.450869 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:53.570191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:54.054732 run create_hlr_db(pid=15105): Launched 05:58:54.174012 bus /sierra_2: Setting Powered False 05:58:55.236030 run create_hlr_db(pid=15105): Terminated: ok {rc=0} 05:58:55.690887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15107): Launched 05:58:56.024454 run osmo-hlr_10.42.42.2(pid=15108): Launched 05:58:56.151543 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:56.725247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15110): Launched 05:58:57.058290 run osmo-stp_10.42.42.5(pid=15111): Launched 05:58:57.187360 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:57.790800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15113): Launched 05:58:58.125676 run osmo-msc_10.42.42.6(pid=15114): Launched 05:58:58.310936 run osmo-stp_10.42.42.5(pid=15111): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15111)] 05:58:58.451217 run osmo-stp_10.42.42.5(pid=15111): stdout: | (launched: 2022-12-14_05:58:56.997903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:58.591775 run osmo-stp_10.42.42.5(pid=15111): stderr: | 20221214055857192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055857192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055857192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055857193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055857193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055857194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055857194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:58.732126 run osmo-stp_10.42.42.5(pid=15111): stdout: | (launched: 2022-12-14_05:58:56.997903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:58.864730 run osmo-stp_10.42.42.5(pid=15111): stderr: | 20221214055857192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055857192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055857192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055857193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055857193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055857194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055857194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:59.023248 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15111): Process ended prematurely: osmo-stp_10.42.42.5(pid=15111) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15111)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:58:59.033117 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:58:59.060521 run osmo-hlr_10.42.42.2(pid=15108): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15108)] 05:58:59.110374 run osmo-hlr_10.42.42.2(pid=15108): stdout: | (launched: 2022-12-14_05:58:55.963939) 05:58:59.162188 run osmo-hlr_10.42.42.2(pid=15108): stderr: | 20221214055856165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055856165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055856165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055856165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055856165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055856165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055856178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055856186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055856186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055856186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:59.234179 run osmo-msc_10.42.42.6(pid=15114): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15114)] 05:58:59.283899 run osmo-msc_10.42.42.6(pid=15114): stdout: | (launched: 2022-12-14_05:58:58.064802) 05:58:59.335516 run osmo-msc_10.42.42.6(pid=15114): stderr: | 20221214055858390 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055858390 DLGLOBAL DEBUG validating counter group 0x7f6f1088dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055858390 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055858390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055858390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055858390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055858394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055858394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055858394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055858394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:59.387487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15107): Terminating (SIGTERM) 05:58:59.429146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15110): Terminating (SIGTERM) 05:58:59.470892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15113): Terminating (SIGTERM) 05:58:59.512720 --- ParallelTerminationStrategy: PID 15107 died... 05:58:59.532664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15107): Terminated: ok {rc=0} 05:58:59.578647 --- ParallelTerminationStrategy: PID 15110 died... 05:58:59.598501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15110): Terminated: ok {rc=0} 05:58:59.644207 --- ParallelTerminationStrategy: PID 15113 died... 05:58:59.663636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15113): Terminated: ok {rc=0} 05:58:59.750665 bus /sierra_3: Setting Powered False 05:59:00.863570 bus /sierra_3: Setting Powered False 05:59:01.990050 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:59:03.139238 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:59:03.151416 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:59:03.226216 tst mo_mt_call_osmux.py: using LAC 38885 05:59:03.358576 tst mo_mt_call_osmux.py: using RAC 125 05:59:03.488656 tst mo_mt_call_osmux.py: using CellId 38885 05:59:03.617948 tst mo_mt_call_osmux.py: using BVCI 38886 05:59:03.739381 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:59:03.751452 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:59:03.763084 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:59:03.774856 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:59:03.786662 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:59:03.798353 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:59:03.914871 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:59:04.036630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:04.554505 run create_hlr_db(pid=15116): Launched 05:59:04.692127 bus /sierra_2: Setting Powered False 05:59:05.758680 run create_hlr_db(pid=15116): Terminated: ok {rc=0} 05:59:06.205808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15118): Launched 05:59:06.519120 run osmo-hlr_10.42.42.2(pid=15119): Launched 05:59:06.640231 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:07.192778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15121): Launched 05:59:07.506205 run osmo-stp_10.42.42.5(pid=15122): Launched 05:59:07.626756 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:08.194642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15124): Launched 05:59:08.510023 run osmo-msc_10.42.42.6(pid=15125): Launched 05:59:08.689070 run osmo-stp_10.42.42.5(pid=15122): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15122)] 05:59:08.822626 run osmo-stp_10.42.42.5(pid=15122): stdout: | (launched: 2022-12-14_05:59:07.448908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:08.954972 run osmo-stp_10.42.42.5(pid=15122): stderr: | 20221214055907622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055907622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055907623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055907623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055907624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055907624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055907624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:09.085263 run osmo-stp_10.42.42.5(pid=15122): stdout: | (launched: 2022-12-14_05:59:07.448908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:09.210184 run osmo-stp_10.42.42.5(pid=15122): stderr: | 20221214055907622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055907622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055907623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055907623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055907624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055907624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055907624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:09.359843 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15122): Process ended prematurely: osmo-stp_10.42.42.5(pid=15122) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15122)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:59:09.369108 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:59:09.395750 run osmo-hlr_10.42.42.2(pid=15119): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15119)] 05:59:09.444154 run osmo-hlr_10.42.42.2(pid=15119): stdout: | (launched: 2022-12-14_05:59:06.462166) 05:59:09.494138 run osmo-hlr_10.42.42.2(pid=15119): stderr: | 20221214055906659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055906659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055906659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055906660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055906660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055906660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055906675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055906683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055906683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055906683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:09.563975 run osmo-msc_10.42.42.6(pid=15125): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15125)] 05:59:09.611827 run osmo-msc_10.42.42.6(pid=15125): stdout: | (launched: 2022-12-14_05:59:08.452368) 05:59:09.661739 run osmo-msc_10.42.42.6(pid=15125): stderr: | 20221214055908728 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055908728 DLGLOBAL DEBUG validating counter group 0x7f72142e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055908728 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055908728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055908728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055908728 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055908730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055908731 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055908731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055908731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:09.712035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15118): Terminating (SIGTERM) 05:59:09.752680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15121): Terminating (SIGTERM) 05:59:09.793237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15124): Terminating (SIGTERM) 05:59:09.833934 --- ParallelTerminationStrategy: PID 15118 died... 05:59:09.853746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15118): Terminated: ok {rc=0} 05:59:09.898516 --- ParallelTerminationStrategy: PID 15121 died... 05:59:09.917911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15121): Terminated: ok {rc=0} 05:59:09.962740 --- ParallelTerminationStrategy: PID 15124 died... 05:59:09.982059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15124): Terminated: ok {rc=0} 05:59:10.069821 bus /sierra_3: Setting Powered False 05:59:11.170024 bus /sierra_3: Setting Powered False 05:59:12.284366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:59:13.536724 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:59:13.542554 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:59:13.575673 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:59:13.602850 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:59:13.656031 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:59:13.690385 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:59:13.717575 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:59:14.264599 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:59:14.316348 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:14.327574 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:59:14.398819 tst mo_mt_call.py: using LAC 38886 05:59:14.522351 tst mo_mt_call.py: using RAC 126 05:59:14.653869 tst mo_mt_call.py: using CellId 38886 05:59:14.787029 tst mo_mt_call.py: using BVCI 38887 05:59:14.908151 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:14.919729 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:14.931060 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:14.942534 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:14.953973 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:14.965330 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:59:15.083535 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:59:15.203793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:15.722588 run create_hlr_db(pid=15130): Launched 05:59:15.866349 bus /sierra_2: Setting Powered False 05:59:16.930689 run create_hlr_db(pid=15130): Terminated: ok {rc=0} 05:59:17.426326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15132): Launched 05:59:17.762230 run osmo-hlr_10.42.42.2(pid=15133): Launched 05:59:17.888632 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:18.470022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15135): Launched 05:59:18.806152 run osmo-stp_10.42.42.5(pid=15136): Launched 05:59:18.933177 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:19.539620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15138): Launched 05:59:19.875377 run osmo-msc_10.42.42.6(pid=15139): Launched 05:59:20.060427 run osmo-stp_10.42.42.5(pid=15136): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15136)] 05:59:20.204637 run osmo-stp_10.42.42.5(pid=15136): stdout: | (launched: 2022-12-14_05:59:18.744076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:20.343880 run osmo-stp_10.42.42.5(pid=15136): stderr: | 20221214055918939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055918939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055918940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055918940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055918940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055918941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055918941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:20.482711 run osmo-stp_10.42.42.5(pid=15136): stdout: | (launched: 2022-12-14_05:59:18.744076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:20.615263 run osmo-stp_10.42.42.5(pid=15136): stderr: | 20221214055918939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055918939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055918940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055918940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055918940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055918941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055918941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:20.774510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15136): Process ended prematurely: osmo-stp_10.42.42.5(pid=15136) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15136)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:59:20.784401 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:59:20.812744 run osmo-hlr_10.42.42.2(pid=15133): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15133)] 05:59:20.863550 run osmo-hlr_10.42.42.2(pid=15133): stdout: | (launched: 2022-12-14_05:59:17.700667) 05:59:20.915995 run osmo-hlr_10.42.42.2(pid=15133): stderr: | 20221214055917903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055917904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055917904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055917904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055917904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055917904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055917916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055917925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055917925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055917925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:20.989255 run osmo-msc_10.42.42.6(pid=15139): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15139)] 05:59:21.040152 run osmo-msc_10.42.42.6(pid=15139): stdout: | (launched: 2022-12-14_05:59:19.814128) 05:59:21.092688 run osmo-msc_10.42.42.6(pid=15139): stderr: | 20221214055920140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055920140 DLGLOBAL DEBUG validating counter group 0x7fea07512c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055920140 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055920140 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055920141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055920141 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055920142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055920143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055920143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055920143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:21.145784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15132): Terminating (SIGTERM) 05:59:21.188064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15135): Terminating (SIGTERM) 05:59:21.230415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15138): Terminating (SIGTERM) 05:59:21.272919 --- ParallelTerminationStrategy: PID 15132 died... 05:59:21.293240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15132): Terminated: ok {rc=0} 05:59:21.339898 --- ParallelTerminationStrategy: PID 15135 died... 05:59:21.359628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15135): Terminated: ok {rc=0} 05:59:21.406251 --- ParallelTerminationStrategy: PID 15138 died... 05:59:21.426017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15138): Terminated: ok {rc=0} 05:59:21.514080 bus /sierra_3: Setting Powered False 05:59:22.614353 bus /sierra_3: Setting Powered False 05:59:23.728924 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:59:24.880724 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:24.893224 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:59:24.968349 tst mo_mt_call_osmux.py: using LAC 38887 05:59:25.100285 tst mo_mt_call_osmux.py: using RAC 127 05:59:25.231627 tst mo_mt_call_osmux.py: using CellId 38887 05:59:25.361482 tst mo_mt_call_osmux.py: using BVCI 38888 05:59:25.483769 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:25.495509 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:25.506974 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:25.518501 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:25.530177 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:59:25.541700 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:59:25.659918 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:59:25.785976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:26.303320 run create_hlr_db(pid=15141): Launched 05:59:26.437407 bus /sierra_2: Setting Powered False 05:59:27.502594 run create_hlr_db(pid=15141): Terminated: ok {rc=0} 05:59:27.965451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15143): Launched 05:59:28.297682 run osmo-hlr_10.42.42.2(pid=15144): Launched 05:59:28.425486 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:29.000704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15146): Launched 05:59:29.334364 run osmo-stp_10.42.42.5(pid=15147): Launched 05:59:29.462598 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:30.066675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15149): Launched 05:59:30.402197 run osmo-msc_10.42.42.6(pid=15150): Launched 05:59:30.589113 run osmo-stp_10.42.42.5(pid=15147): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15147)] 05:59:30.731277 run osmo-stp_10.42.42.5(pid=15147): stdout: | (launched: 2022-12-14_05:59:29.273742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:30.874120 run osmo-stp_10.42.42.5(pid=15147): stderr: | 20221214055929471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055929471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055929471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055929472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055929472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055929472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055929472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:31.034143 run osmo-stp_10.42.42.5(pid=15147): stdout: | (launched: 2022-12-14_05:59:29.273742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:31.168727 run osmo-stp_10.42.42.5(pid=15147): stderr: | 20221214055929471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055929471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055929471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055929472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055929472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055929472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055929472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:31.330730 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15147): Process ended prematurely: osmo-stp_10.42.42.5(pid=15147) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15147)] [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:59:31.341620 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:59:31.370743 run osmo-hlr_10.42.42.2(pid=15144): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15144)] 05:59:31.423541 run osmo-hlr_10.42.42.2(pid=15144): stdout: | (launched: 2022-12-14_05:59:28.237354) 05:59:31.477243 run osmo-hlr_10.42.42.2(pid=15144): stderr: | 20221214055928438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055928438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055928438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055928438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055928438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055928438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055928450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055928458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055928458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055928459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:31.551706 run osmo-msc_10.42.42.6(pid=15150): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15150)] 05:59:31.604606 run osmo-msc_10.42.42.6(pid=15150): stdout: | (launched: 2022-12-14_05:59:30.341288) 05:59:31.658306 run osmo-msc_10.42.42.6(pid=15150): stderr: | 20221214055930664 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055930664 DLGLOBAL DEBUG validating counter group 0x7ff308fc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055930664 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055930664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055930664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055930664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055930666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055930666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055930667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055930667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:31.711981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15143): Terminating (SIGTERM) 05:59:31.755838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15146): Terminating (SIGTERM) 05:59:31.813607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15149): Terminating (SIGTERM) 05:59:31.869672 --- ParallelTerminationStrategy: PID 15143 died... 05:59:31.893506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15143): Terminated: ok {rc=0} 05:59:31.951988 --- ParallelTerminationStrategy: PID 15146 died... 05:59:31.976456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15146): Terminated: ok {rc=0} 05:59:32.034977 --- ParallelTerminationStrategy: PID 15149 died... 05:59:32.059089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15149): Terminated: ok {rc=0} 05:59:32.168400 bus /sierra_3: Setting Powered False 05:59:33.274986 bus /sierra_3: Setting Powered False 05:59:34.392597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 05:59:35.642850 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:59:35.647236 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:59:35.680502 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:59:35.708009 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 05:59:35.795176 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:59:35.831389 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:59:35.859775 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 05:59:36.436099 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 05:59:36.442708 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:36.454636 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:36.509048 tst emergency_mo_mt_call.py: using LAC 38888 05:59:36.638499 tst emergency_mo_mt_call.py: using RAC 128 05:59:36.768491 tst emergency_mo_mt_call.py: using CellId 38888 05:59:36.897222 tst emergency_mo_mt_call.py: using BVCI 38889 05:59:37.018411 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:37.029888 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:37.040842 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:37.051931 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:37.063124 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:37.074300 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:37.192532 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:37.312409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:37.822083 run create_hlr_db(pid=15155): Launched 05:59:37.954381 bus /sierra_2: Setting Powered False 05:59:39.015514 run create_hlr_db(pid=15155): Terminated: ok {rc=0} 05:59:39.455670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15157): Launched 05:59:39.764232 run osmo-hlr_10.42.42.2(pid=15158): Launched 05:59:39.882120 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:40.426631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15160): Launched 05:59:40.735006 run osmo-stp_10.42.42.5(pid=15161): Launched 05:59:40.862281 tst emergency_mo_mt_call.py: using MSISDN 8531 05:59:41.028411 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:41.619961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15163): Launched 05:59:41.947947 run osmo-msc_10.42.42.6(pid=15164): Launched 05:59:42.130713 run osmo-stp_10.42.42.5(pid=15161): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15161)] 05:59:42.268042 run osmo-stp_10.42.42.5(pid=15161): stdout: | (launched: 2022-12-14_05:59:40.678381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:42.406214 run osmo-stp_10.42.42.5(pid=15161): stderr: | 20221214055940849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055940849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055940849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055940850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055940850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055940850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055940850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:42.542766 run osmo-stp_10.42.42.5(pid=15161): stdout: | (launched: 2022-12-14_05:59:40.678381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:42.672817 run osmo-stp_10.42.42.5(pid=15161): stderr: | 20221214055940849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055940849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055940849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055940850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055940850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055940850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055940850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:42.829020 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15161): Process ended prematurely: osmo-stp_10.42.42.5(pid=15161) [trial-2400↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15161)] [trial-2400↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 05:59:42.838044 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 05:59:42.865224 run osmo-hlr_10.42.42.2(pid=15158): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15158)] 05:59:42.915680 run osmo-hlr_10.42.42.2(pid=15158): stdout: | (launched: 2022-12-14_05:59:39.706921) 05:59:42.968345 run osmo-hlr_10.42.42.2(pid=15158): stderr: | 20221214055939886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055939886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055939886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055939886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055939886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055939886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055939898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055939907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055939907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055939907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:43.041534 run osmo-msc_10.42.42.6(pid=15164): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15164)] 05:59:43.092011 run osmo-msc_10.42.42.6(pid=15164): stdout: | (launched: 2022-12-14_05:59:41.887930) 05:59:43.144177 run osmo-msc_10.42.42.6(pid=15164): stderr: | 20221214055942211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055942211 DLGLOBAL DEBUG validating counter group 0x7fe4117c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055942212 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055942212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055942212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055942212 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055942214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055942215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055942215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055942215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:43.196755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15157): Terminating (SIGTERM) 05:59:43.239015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15160): Terminating (SIGTERM) 05:59:43.281758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15163): Terminating (SIGTERM) 05:59:43.324277 --- ParallelTerminationStrategy: PID 15157 died... 05:59:43.344530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15157): Terminated: ok {rc=0} 05:59:43.391263 --- ParallelTerminationStrategy: PID 15160 died... 05:59:43.410930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15160): Terminated: ok {rc=0} 05:59:43.457553 --- ParallelTerminationStrategy: PID 15163 died... 05:59:43.477378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15163): Terminated: ok {rc=0} 05:59:43.566592 bus /sierra_3: Setting Powered False 05:59:44.666222 bus /sierra_3: Setting Powered False 05:59:45.782796 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 05:59:46.890199 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:46.906361 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:46.974275 tst emergency_preemptive_call.py: using LAC 38889 05:59:47.109295 tst emergency_preemptive_call.py: using RAC 129 05:59:47.257068 tst emergency_preemptive_call.py: using CellId 38889 05:59:47.384346 tst emergency_preemptive_call.py: using BVCI 38890 05:59:47.503382 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:47.514826 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:47.525968 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:47.537029 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:47.548191 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:47.559301 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:47.677939 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:47.794608 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:47.914915 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:48.030745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:48.509637 run create_hlr_db(pid=15166): Launched 05:59:48.628045 bus /sierra_2: Setting Powered False 05:59:49.689967 run create_hlr_db(pid=15166): Terminated: ok {rc=0} 05:59:50.139520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15168): Launched 05:59:50.468021 run osmo-hlr_10.42.42.2(pid=15169): Launched 05:59:50.594247 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:51.165690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15171): Launched 05:59:51.493743 run osmo-stp_10.42.42.5(pid=15172): Launched 05:59:51.634183 tst emergency_preemptive_call.py: using MSISDN 8532 05:59:51.804276 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:52.392935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15174): Launched 05:59:52.720630 run osmo-msc_10.42.42.6(pid=15175): Launched 05:59:52.904939 run osmo-stp_10.42.42.5(pid=15172): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15172)] 05:59:53.043264 run osmo-stp_10.42.42.5(pid=15172): stdout: | (launched: 2022-12-14_05:59:51.434098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:53.182710 run osmo-stp_10.42.42.5(pid=15172): stderr: | 20221214055951628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055951628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055951628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055951629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055951629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055951629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055951629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:53.320031 run osmo-stp_10.42.42.5(pid=15172): stdout: | (launched: 2022-12-14_05:59:51.434098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:53.450956 run osmo-stp_10.42.42.5(pid=15172): stderr: | 20221214055951628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214055951628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214055951628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214055951629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214055951629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214055951629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214055951629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:53.606637 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15172): Process ended prematurely: osmo-stp_10.42.42.5(pid=15172) [trial-2400↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15172)] [trial-2400↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 05:59:53.615833 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 05:59:53.643756 run osmo-hlr_10.42.42.2(pid=15169): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15169)] 05:59:53.694857 run osmo-hlr_10.42.42.2(pid=15169): stdout: | (launched: 2022-12-14_05:59:50.408260) 05:59:53.748318 run osmo-hlr_10.42.42.2(pid=15169): stderr: | 20221214055950608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214055950608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214055950609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214055950609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214055950609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214055950609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214055950621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214055950629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214055950629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214055950629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:53.822335 run osmo-msc_10.42.42.6(pid=15175): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15175)] 05:59:53.873119 run osmo-msc_10.42.42.6(pid=15175): stdout: | (launched: 2022-12-14_05:59:52.660617) 05:59:53.925487 run osmo-msc_10.42.42.6(pid=15175): stderr: | 20221214055952984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214055952984 DLGLOBAL DEBUG validating counter group 0x7f1acf259c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214055952984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214055952984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214055952984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214055952985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214055952986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214055952987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214055952987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214055952987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:53.978037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15168): Terminating (SIGTERM) 05:59:54.020122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15171): Terminating (SIGTERM) 05:59:54.062306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15174): Terminating (SIGTERM) 05:59:54.104528 --- ParallelTerminationStrategy: PID 15168 died... 05:59:54.124867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15168): Terminated: ok {rc=0} 05:59:54.171363 --- ParallelTerminationStrategy: PID 15171 died... 05:59:54.191214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15171): Terminated: ok {rc=0} 05:59:54.237723 --- ParallelTerminationStrategy: PID 15174 died... 05:59:54.257625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15174): Terminated: ok {rc=0} 05:59:54.345532 bus /sierra_9: Setting Powered False 05:59:55.445155 bus /sierra_9: Setting Powered False 05:59:56.560642 bus /sierra_8: Setting Powered False 05:59:57.657778 bus /sierra_8: Setting Powered False 05:59:58.774353 bus /sierra_3: Setting Powered False 05:59:59.871391 bus /sierra_3: Setting Powered False 06:00:01.006789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 06:00:02.342852 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:00:02.347949 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 06:00:02.383305 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 06:00:02.424303 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 06:00:02.514967 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 06:00:02.551246 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 06:00:02.607478 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 06:00:03.183046 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 06:00:03.238829 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.250232 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:03.301191 tst cs_paging_gprs_active.py: using LAC 38890 06:00:03.431670 tst cs_paging_gprs_active.py: using RAC 130 06:00:03.561209 tst cs_paging_gprs_active.py: using CellId 38890 06:00:03.691169 tst cs_paging_gprs_active.py: using BVCI 38891 06:00:03.814580 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.826024 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.837102 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.848125 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.859091 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.870076 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.881299 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.892173 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:03.903409 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:04.022140 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:04.143887 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:00:04.371203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:04.708030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15210): Launched 06:00:04.999548 run iperf3-srv_10.42.42.10(pid=15211): Launched 06:00:05.125035 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:00:05.353073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:05.689388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15212): Launched 06:00:05.981533 run iperf3-srv_10.42.42.10(pid=15213): Launched 06:00:06.107108 tst cs_paging_gprs_active.py:38: start network... 06:00:06.333419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:06.852346 run create_hlr_db(pid=15214): Launched 06:00:06.988268 bus /sierra_2: Setting Powered False 06:00:08.053922 run create_hlr_db(pid=15214): Terminated: ok {rc=0} 06:00:08.502484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15217): Launched 06:00:08.817438 run osmo-hlr_10.42.42.2(pid=15218): Launched 06:00:08.937655 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:09.494114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15220): Launched 06:00:09.809505 run osmo-stp_10.42.42.5(pid=15221): Launched 06:00:09.929715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:10.472167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15223): Launched 06:00:10.593482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:10.860497 run patchelf(pid=15224): Launched 06:00:11.035465 run osmo-stp_10.42.42.5(pid=15221): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15221)] 06:00:11.168735 run osmo-stp_10.42.42.5(pid=15221): stdout: | (launched: 2022-12-14_06:00:09.751331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:11.304146 run osmo-stp_10.42.42.5(pid=15221): stderr: | 20221214060009927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060009927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060009927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060009927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060009928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060009928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060009928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:11.439499 run osmo-stp_10.42.42.5(pid=15221): stdout: | (launched: 2022-12-14_06:00:09.751331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:11.568002 run osmo-stp_10.42.42.5(pid=15221): stderr: | 20221214060009927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060009927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060009927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060009927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060009928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060009928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060009928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:11.720848 run patchelf(pid=15224): Terminating (SIGINT) 06:00:11.898616 run patchelf(pid=15224): Terminated: ok {rc=0} 06:00:12.026500 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15221): Process ended prematurely: osmo-stp_10.42.42.5(pid=15221) [trial-2400↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15221)] [trial-2400↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 06:00:12.036245 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:00:12.063630 run osmo-hlr_10.42.42.2(pid=15218): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15218)] 06:00:12.112150 run osmo-hlr_10.42.42.2(pid=15218): stdout: | (launched: 2022-12-14_06:00:08.759868) 06:00:12.162143 run osmo-hlr_10.42.42.2(pid=15218): stderr: | 20221214060008939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060008939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060008939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060008939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060008939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060008939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060008950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060008958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060008958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060008958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:12.212495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15210): Terminating (SIGTERM) 06:00:12.253094 run iperf3-srv_10.42.42.10(pid=15211): Terminating (SIGTERM) 06:00:12.293303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15212): Terminating (SIGTERM) 06:00:12.333618 run iperf3-srv_10.42.42.10(pid=15213): Terminating (SIGTERM) 06:00:12.373741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15217): Terminating (SIGTERM) 06:00:12.414003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15220): Terminating (SIGTERM) 06:00:12.454155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15223): Terminating (SIGTERM) 06:00:12.494584 --- ParallelTerminationStrategy: PID 15210 died... 06:00:12.514020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15210): Terminated: ok {rc=0} 06:00:12.558466 --- ParallelTerminationStrategy: PID 15211 died... 06:00:12.577266 run iperf3-srv_10.42.42.10(pid=15211): Terminated {rc=256} 06:00:12.621471 --- ParallelTerminationStrategy: PID 15212 died... 06:00:12.640507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15212): Terminated: ok {rc=0} 06:00:12.684866 --- ParallelTerminationStrategy: PID 15213 died... 06:00:12.704238 run iperf3-srv_10.42.42.10(pid=15213): Terminated {rc=256} 06:00:12.748500 --- ParallelTerminationStrategy: PID 15217 died... 06:00:12.767642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15217): Terminated: ok {rc=0} 06:00:12.812170 --- ParallelTerminationStrategy: PID 15220 died... 06:00:12.831319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15220): Terminated: ok {rc=0} 06:00:12.876205 --- ParallelTerminationStrategy: PID 15223 died... 06:00:12.895635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15223): Terminated: ok {rc=0} 06:00:12.982875 bus /gobi_0: Setting Powered False 06:00:14.086584 bus /gobi_0: Setting Powered False 06:00:15.204338 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 06:00:16.379031 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:16.394159 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:16.457264 tst iperf3.py: using LAC 38891 06:00:16.591409 tst iperf3.py: using RAC 131 06:00:16.732509 tst iperf3.py: using CellId 38891 06:00:16.908939 tst iperf3.py: using BVCI 38892 06:00:17.038964 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.051076 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.063275 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.075566 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.087907 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.099757 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.111837 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.123652 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:17.135616 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:17.254266 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:00:17.466842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:17.782616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15226): Launched 06:00:18.058890 run iperf3-srv_10.42.42.10(pid=15227): Launched 06:00:18.177822 tst iperf3.py:8: start network... 06:00:18.389531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:18.878485 run create_hlr_db(pid=15228): Launched 06:00:19.000937 bus /gobi_6: Setting Powered False 06:00:20.063099 run create_hlr_db(pid=15228): Terminated: ok {rc=0} 06:00:20.520618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15230): Launched 06:00:20.857032 run osmo-hlr_10.42.42.2(pid=15231): Launched 06:00:20.984258 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:21.563953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15233): Launched 06:00:21.900882 run osmo-stp_10.42.42.5(pid=15234): Launched 06:00:22.029776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:22.611162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15236): Launched 06:00:22.742342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:23.027153 run patchelf(pid=15237): Launched 06:00:23.215269 run osmo-stp_10.42.42.5(pid=15234): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15234)] 06:00:23.357702 run osmo-stp_10.42.42.5(pid=15234): stdout: | (launched: 2022-12-14_06:00:21.839632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:23.501272 run osmo-stp_10.42.42.5(pid=15234): stderr: | 20221214060022035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060022036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060022036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060022036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060022037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060022037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060022037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:23.645075 run osmo-stp_10.42.42.5(pid=15234): stdout: | (launched: 2022-12-14_06:00:21.839632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:23.782805 run osmo-stp_10.42.42.5(pid=15234): stderr: | 20221214060022035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060022036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060022036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060022036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060022037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060022037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060022037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:23.945344 run patchelf(pid=15237): Terminating (SIGINT) 06:00:24.133302 run patchelf(pid=15237): Terminated: ok {rc=0} 06:00:24.268746 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15234): Process ended prematurely: osmo-stp_10.42.42.5(pid=15234) [trial-2400↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15234)] [trial-2400↪gprs:trx-sysmocell5000↪iperf3.py:8] 06:00:24.279297 tst iperf3.py:8: Test FAILED (8.0 sec) 06:00:24.308067 run osmo-hlr_10.42.42.2(pid=15231): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15231)] 06:00:24.359225 run osmo-hlr_10.42.42.2(pid=15231): stdout: | (launched: 2022-12-14_06:00:20.795912) 06:00:24.412235 run osmo-hlr_10.42.42.2(pid=15231): stderr: | 20221214060020997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060020997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060020997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060020997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060020997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060020997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060021010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060021018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060021018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060021018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:24.465596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15226): Terminating (SIGTERM) 06:00:24.508387 run iperf3-srv_10.42.42.10(pid=15227): Terminating (SIGTERM) 06:00:24.551497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15230): Terminating (SIGTERM) 06:00:24.594778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15233): Terminating (SIGTERM) 06:00:24.637735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15236): Terminating (SIGTERM) 06:00:24.680935 --- ParallelTerminationStrategy: PID 15226 died... 06:00:24.701761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15226): Terminated: ok {rc=0} 06:00:24.749556 --- ParallelTerminationStrategy: PID 15227 died... 06:00:24.769555 run iperf3-srv_10.42.42.10(pid=15227): Terminated {rc=256} 06:00:24.816419 --- ParallelTerminationStrategy: PID 15230 died... 06:00:24.836331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15230): Terminated: ok {rc=0} 06:00:24.883245 --- ParallelTerminationStrategy: PID 15233 died... 06:00:24.903328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15233): Terminated: ok {rc=0} 06:00:24.950108 --- ParallelTerminationStrategy: PID 15236 died... 06:00:24.970006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15236): Terminated: ok {rc=0} 06:00:25.059608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 06:00:26.212879 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.225359 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:26.276498 tst iperf3m4.py: using LAC 38892 06:00:26.407695 tst iperf3m4.py: using RAC 132 06:00:26.537451 tst iperf3m4.py: using CellId 38892 06:00:26.661440 tst iperf3m4.py: using BVCI 38893 06:00:26.783763 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.795425 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.807010 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.818384 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.829698 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.841205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.853028 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.864328 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:26.875800 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:26.997932 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:27.122893 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:27.242045 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:27.363619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:00:27.591637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:27.928758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15238): Launched 06:00:28.221097 run iperf3-srv_10.42.42.10(pid=15239): Launched 06:00:28.346517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:00:28.572781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:28.910118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15240): Launched 06:00:29.201590 run iperf3-srv_10.42.42.10(pid=15241): Launched 06:00:29.328421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:00:29.555078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:29.892568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15242): Launched 06:00:30.183999 run iperf3-srv_10.42.42.10(pid=15243): Launched 06:00:30.309387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:00:30.536448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:30.895297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15244): Launched 06:00:31.253746 run iperf3-srv_10.42.42.10(pid=15245): Launched 06:00:31.426099 tst iperf3m4.py:8: start network... 06:00:31.658703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:32.197184 run create_hlr_db(pid=15246): Launched 06:00:32.343680 bus /gobi_6: Setting Powered False 06:00:33.409518 run create_hlr_db(pid=15246): Terminated: ok {rc=0} 06:00:33.875020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15248): Launched 06:00:34.212814 run osmo-hlr_10.42.42.2(pid=15249): Launched 06:00:34.340135 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:34.924890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15251): Launched 06:00:35.261129 run osmo-stp_10.42.42.5(pid=15252): Launched 06:00:35.389251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:35.974294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15254): Launched 06:00:36.102693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:36.386722 run patchelf(pid=15255): Launched 06:00:36.574194 run osmo-stp_10.42.42.5(pid=15252): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15252)] 06:00:36.715974 run osmo-stp_10.42.42.5(pid=15252): stdout: | (launched: 2022-12-14_06:00:35.199906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:36.860363 run osmo-stp_10.42.42.5(pid=15252): stderr: | 20221214060035395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060035395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060035395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060035395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060035396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060035396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060035396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:37.004185 run osmo-stp_10.42.42.5(pid=15252): stdout: | (launched: 2022-12-14_06:00:35.199906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:37.141471 run osmo-stp_10.42.42.5(pid=15252): stderr: | 20221214060035395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060035395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060035395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060035395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060035396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060035396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060035396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:37.303880 run patchelf(pid=15255): Terminating (SIGINT) 06:00:37.491519 run patchelf(pid=15255): Terminated: ok {rc=0} 06:00:37.626882 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15252): Process ended prematurely: osmo-stp_10.42.42.5(pid=15252) [trial-2400↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15252)] [trial-2400↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 06:00:37.637279 tst iperf3m4.py:8: Test FAILED (11.5 sec) 06:00:37.666196 run osmo-hlr_10.42.42.2(pid=15249): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15249)] 06:00:37.716436 run osmo-hlr_10.42.42.2(pid=15249): stdout: | (launched: 2022-12-14_06:00:34.151552) 06:00:37.769125 run osmo-hlr_10.42.42.2(pid=15249): stderr: | 20221214060034353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060034353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060034353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060034353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060034354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060034354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060034366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060034375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060034375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060034375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:37.821956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15238): Terminating (SIGTERM) 06:00:37.864066 run iperf3-srv_10.42.42.10(pid=15239): Terminating (SIGTERM) 06:00:37.906483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15240): Terminating (SIGTERM) 06:00:37.949295 run iperf3-srv_10.42.42.10(pid=15241): Terminating (SIGTERM) 06:00:37.991864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15242): Terminating (SIGTERM) 06:00:38.034377 run iperf3-srv_10.42.42.10(pid=15243): Terminating (SIGTERM) 06:00:38.077035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15244): Terminating (SIGTERM) 06:00:38.119674 run iperf3-srv_10.42.42.10(pid=15245): Terminating (SIGTERM) 06:00:38.161623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15248): Terminating (SIGTERM) 06:00:38.204185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15251): Terminating (SIGTERM) 06:00:38.246739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15254): Terminating (SIGTERM) 06:00:38.289205 --- ParallelTerminationStrategy: PID 15238 died... 06:00:38.309392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15238): Terminated: ok {rc=0} 06:00:38.355924 --- ParallelTerminationStrategy: PID 15239 died... 06:00:38.375586 run iperf3-srv_10.42.42.10(pid=15239): Terminated {rc=256} 06:00:38.421696 --- ParallelTerminationStrategy: PID 15240 died... 06:00:38.441285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15240): Terminated: ok {rc=0} 06:00:38.487582 --- ParallelTerminationStrategy: PID 15241 died... 06:00:38.507305 run iperf3-srv_10.42.42.10(pid=15241): Terminated {rc=256} 06:00:38.553519 --- ParallelTerminationStrategy: PID 15242 died... 06:00:38.573227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15242): Terminated: ok {rc=0} 06:00:38.619378 --- ParallelTerminationStrategy: PID 15243 died... 06:00:38.638996 run iperf3-srv_10.42.42.10(pid=15243): Terminated {rc=256} 06:00:38.685236 --- ParallelTerminationStrategy: PID 15244 died... 06:00:38.705028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15244): Terminated: ok {rc=0} 06:00:38.751445 --- ParallelTerminationStrategy: PID 15245 died... 06:00:38.771125 run iperf3-srv_10.42.42.10(pid=15245): Terminated {rc=256} 06:00:38.817257 --- ParallelTerminationStrategy: PID 15248 died... 06:00:38.837057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15248): Terminated: ok {rc=0} 06:00:38.883406 --- ParallelTerminationStrategy: PID 15251 died... 06:00:38.903128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15251): Terminated: ok {rc=0} 06:00:38.949537 --- ParallelTerminationStrategy: PID 15254 died... 06:00:38.969316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15254): Terminated: ok {rc=0} 06:00:39.057582 bus /gobi_4: Setting Powered False 06:00:40.157100 bus /gobi_4: Setting Powered False 06:00:41.271532 bus /gobi_1: Setting Powered False 06:00:42.369762 bus /gobi_1: Setting Powered False 06:00:43.485762 bus /gobi_0: Setting Powered False 06:00:44.584591 bus /gobi_0: Setting Powered False 06:00:45.701820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 06:00:46.805254 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:46.818066 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:46.877414 tst ping.py: using LAC 38893 06:00:47.000852 tst ping.py: using RAC 133 06:00:47.163874 tst ping.py: using CellId 38893 06:00:47.293257 tst ping.py: using BVCI 38894 06:00:47.407876 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.418860 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.429958 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.440645 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.452619 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.464225 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.476179 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:47.488030 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:47.608067 tst ping.py:19: start network... 06:00:47.831940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:48.339659 run create_hlr_db(pid=15256): Launched 06:00:48.473686 bus /gobi_6: Setting Powered False 06:00:49.538795 run create_hlr_db(pid=15256): Terminated: ok {rc=0} 06:00:49.976602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15258): Launched 06:00:50.285362 run osmo-hlr_10.42.42.2(pid=15259): Launched 06:00:50.403263 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:50.951313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15261): Launched 06:00:51.258801 run osmo-stp_10.42.42.5(pid=15262): Launched 06:00:51.377831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:51.909464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15264): Launched 06:00:52.029580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:52.290319 run patchelf(pid=15265): Launched 06:00:52.461976 run osmo-stp_10.42.42.5(pid=15262): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15262)] 06:00:52.592686 run osmo-stp_10.42.42.5(pid=15262): stdout: | (launched: 2022-12-14_06:00:51.202419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:52.725831 run osmo-stp_10.42.42.5(pid=15262): stderr: | 20221214060051373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060051373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060051374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060051374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060051375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060051375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060051375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:52.858635 run osmo-stp_10.42.42.5(pid=15262): stdout: | (launched: 2022-12-14_06:00:51.202419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:52.984857 run osmo-stp_10.42.42.5(pid=15262): stderr: | 20221214060051373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060051373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060051374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060051374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060051375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060051375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060051375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:53.134748 run patchelf(pid=15265): Terminating (SIGINT) 06:00:53.307092 run patchelf(pid=15265): Terminated: ok {rc=0} 06:00:53.431475 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15262): Process ended prematurely: osmo-stp_10.42.42.5(pid=15262) [trial-2400↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15262)] [trial-2400↪gprs:trx-sysmocell5000↪ping.py:22] 06:00:53.440397 tst ping.py:22: Test FAILED (6.6 sec) 06:00:53.467739 run osmo-hlr_10.42.42.2(pid=15259): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15259)] 06:00:53.516598 run osmo-hlr_10.42.42.2(pid=15259): stdout: | (launched: 2022-12-14_06:00:50.228736) 06:00:53.566810 run osmo-hlr_10.42.42.2(pid=15259): stderr: | 20221214060050408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060050408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060050408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060050408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060050408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060050408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060050423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060050433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060050433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060050433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:53.617514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15258): Terminating (SIGTERM) 06:00:53.658336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15261): Terminating (SIGTERM) 06:00:53.699006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15264): Terminating (SIGTERM) 06:00:53.739807 --- ParallelTerminationStrategy: PID 15258 died... 06:00:53.759572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15258): Terminated: ok {rc=0} 06:00:53.804590 --- ParallelTerminationStrategy: PID 15261 died... 06:00:53.823950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15261): Terminated: ok {rc=0} 06:00:53.868902 --- ParallelTerminationStrategy: PID 15264 died... 06:00:53.888590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15264): Terminated: ok {rc=0} 06:00:53.976141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 06:00:55.067587 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.079635 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:55.131544 tst ping_idle_ping.py: using LAC 38894 06:00:55.263258 tst ping_idle_ping.py: using RAC 134 06:00:55.394885 tst ping_idle_ping.py: using CellId 38894 06:00:55.525064 tst ping_idle_ping.py: using BVCI 38895 06:00:55.645997 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.657470 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.668771 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.680481 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.691846 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.703262 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.714838 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:55.726237 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:55.845228 tst ping_idle_ping.py:24: start network... 06:00:56.068420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:56.580668 run create_hlr_db(pid=15266): Launched 06:00:56.714655 bus /gobi_6: Setting Powered False 06:00:57.780654 run create_hlr_db(pid=15266): Terminated: ok {rc=0} 06:00:58.222224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15268): Launched 06:00:58.531858 run osmo-hlr_10.42.42.2(pid=15269): Launched 06:00:58.651301 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:59.188565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15271): Launched 06:00:59.497362 run osmo-stp_10.42.42.5(pid=15272): Launched 06:00:59.616420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:00.149281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15274): Launched 06:01:00.267304 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:00.528708 run patchelf(pid=15275): Launched 06:01:00.700409 run osmo-stp_10.42.42.5(pid=15272): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15272)] 06:01:00.838643 run osmo-stp_10.42.42.5(pid=15272): stdout: | (launched: 2022-12-14_06:00:59.440615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:00.998845 run osmo-stp_10.42.42.5(pid=15272): stderr: | 20221214060059612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060059612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060059612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060059613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060059613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060059613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060059613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:01.143910 run osmo-stp_10.42.42.5(pid=15272): stdout: | (launched: 2022-12-14_06:00:59.440615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:01.283483 run osmo-stp_10.42.42.5(pid=15272): stderr: | 20221214060059612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060059612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060059612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060059613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060059613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060059613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060059613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:01.449110 run patchelf(pid=15275): Terminating (SIGINT) 06:01:01.639166 run patchelf(pid=15275): Terminated: ok {rc=0} 06:01:01.778317 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15272): Process ended prematurely: osmo-stp_10.42.42.5(pid=15272) [trial-2400↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15272)] [trial-2400↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 06:01:01.789266 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:01:01.819036 run osmo-hlr_10.42.42.2(pid=15269): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15269)] 06:01:01.872928 run osmo-hlr_10.42.42.2(pid=15269): stdout: | (launched: 2022-12-14_06:00:58.474924) 06:01:01.927137 run osmo-hlr_10.42.42.2(pid=15269): stderr: | 20221214060058652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060058652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060058652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060058652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060058652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060058652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060058665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060058673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060058673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060058673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:01.981759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15268): Terminating (SIGTERM) 06:01:02.026601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15271): Terminating (SIGTERM) 06:01:02.073576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15274): Terminating (SIGTERM) 06:01:02.119187 --- ParallelTerminationStrategy: PID 15268 died... 06:01:02.140341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15268): Terminated: ok {rc=0} 06:01:02.189654 --- ParallelTerminationStrategy: PID 15271 died... 06:01:02.209678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15271): Terminated: ok {rc=0} 06:01:02.256560 --- ParallelTerminationStrategy: PID 15274 died... 06:01:02.277049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15274): Terminated: ok {rc=0} 06:01:02.366594 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 06:01:03.685067 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:01:03.690817 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:01:03.725136 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:01:03.764730 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:01:03.852837 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:01:03.887158 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:01:03.926563 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:01:04.524233 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:01:04.577947 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:04.589463 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:04.641328 tst cs_paging_gprs_active.py: using LAC 38895 06:01:04.772564 tst cs_paging_gprs_active.py: using RAC 135 06:01:04.905359 tst cs_paging_gprs_active.py: using CellId 38895 06:01:05.030096 tst cs_paging_gprs_active.py: using BVCI 38896 06:01:05.145962 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.156916 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.167744 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.178501 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.189545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.200427 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.211762 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.222832 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:05.233993 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:05.355649 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:05.477089 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:01:05.705792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:06.043332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15279): Launched 06:01:06.335511 run iperf3-srv_10.42.42.10(pid=15280): Launched 06:01:06.461205 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:01:06.688346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:07.026245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15281): Launched 06:01:07.317792 run iperf3-srv_10.42.42.10(pid=15282): Launched 06:01:07.444756 tst cs_paging_gprs_active.py:38: start network... 06:01:07.672312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:08.192461 run create_hlr_db(pid=15283): Launched 06:01:08.328699 bus /gobi_6: Setting Powered False 06:01:09.394565 run create_hlr_db(pid=15283): Terminated: ok {rc=0} 06:01:09.844387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15285): Launched 06:01:10.164145 run osmo-hlr_10.42.42.2(pid=15286): Launched 06:01:10.285816 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:10.843141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15288): Launched 06:01:11.158103 run osmo-stp_10.42.42.5(pid=15289): Launched 06:01:11.280362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:11.822952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15291): Launched 06:01:11.943720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:12.209823 run patchelf(pid=15292): Launched 06:01:12.384890 run osmo-stp_10.42.42.5(pid=15289): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15289)] 06:01:12.518607 run osmo-stp_10.42.42.5(pid=15289): stdout: | (launched: 2022-12-14_06:01:11.100618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:12.653683 run osmo-stp_10.42.42.5(pid=15289): stderr: | 20221214060111272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060111272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060111272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060111273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060111273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060111273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060111273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:12.789130 run osmo-stp_10.42.42.5(pid=15289): stdout: | (launched: 2022-12-14_06:01:11.100618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:12.917570 run osmo-stp_10.42.42.5(pid=15289): stderr: | 20221214060111272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060111272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060111272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060111273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060111273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060111273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060111273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:13.070313 run patchelf(pid=15292): Terminating (SIGINT) 06:01:13.246962 run patchelf(pid=15292): Terminated: ok {rc=0} 06:01:13.375299 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15289): Process ended prematurely: osmo-stp_10.42.42.5(pid=15289) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15289)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:01:13.385059 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:01:13.412143 run osmo-hlr_10.42.42.2(pid=15286): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15286)] 06:01:13.460221 run osmo-hlr_10.42.42.2(pid=15286): stdout: | (launched: 2022-12-14_06:01:10.106232) 06:01:13.509692 run osmo-hlr_10.42.42.2(pid=15286): stderr: | 20221214060110284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060110284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060110284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060110284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060110284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060110285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060110297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060110305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060110305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060110305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:13.559531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15279): Terminating (SIGTERM) 06:01:13.599601 run iperf3-srv_10.42.42.10(pid=15280): Terminating (SIGTERM) 06:01:13.639573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15281): Terminating (SIGTERM) 06:01:13.679857 run iperf3-srv_10.42.42.10(pid=15282): Terminating (SIGTERM) 06:01:13.719818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15285): Terminating (SIGTERM) 06:01:13.759710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15288): Terminating (SIGTERM) 06:01:13.799795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15291): Terminating (SIGTERM) 06:01:13.839935 --- ParallelTerminationStrategy: PID 15279 died... 06:01:13.859398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15279): Terminated: ok {rc=0} 06:01:13.903758 --- ParallelTerminationStrategy: PID 15280 died... 06:01:13.922643 run iperf3-srv_10.42.42.10(pid=15280): Terminated {rc=256} 06:01:13.966929 --- ParallelTerminationStrategy: PID 15281 died... 06:01:13.985904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15281): Terminated: ok {rc=0} 06:01:14.030079 --- ParallelTerminationStrategy: PID 15282 died... 06:01:14.049153 run iperf3-srv_10.42.42.10(pid=15282): Terminated {rc=256} 06:01:14.093159 --- ParallelTerminationStrategy: PID 15285 died... 06:01:14.111980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15285): Terminated: ok {rc=0} 06:01:14.155823 --- ParallelTerminationStrategy: PID 15288 died... 06:01:14.174679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15288): Terminated: ok {rc=0} 06:01:14.218549 --- ParallelTerminationStrategy: PID 15291 died... 06:01:14.237534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15291): Terminated: ok {rc=0} 06:01:14.323986 bus /gobi_0: Setting Powered False 06:01:15.423447 bus /gobi_0: Setting Powered False 06:01:16.533960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:01:17.683412 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.695687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:17.751819 tst iperf3.py: using LAC 38896 06:01:17.884335 tst iperf3.py: using RAC 136 06:01:18.013424 tst iperf3.py: using CellId 38896 06:01:18.144212 tst iperf3.py: using BVCI 38897 06:01:18.266428 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.278313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.289734 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.301291 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.312598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.324059 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.335536 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.346837 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:18.358380 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:18.478616 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:01:18.704325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:19.039185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15293): Launched 06:01:19.330897 run iperf3-srv_10.42.42.10(pid=15294): Launched 06:01:19.457257 tst iperf3.py:8: start network... 06:01:19.683465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:20.202801 run create_hlr_db(pid=15295): Launched 06:01:20.340152 bus /gobi_6: Setting Powered False 06:01:21.405552 run create_hlr_db(pid=15295): Terminated: ok {rc=0} 06:01:21.853628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15297): Launched 06:01:22.168867 run osmo-hlr_10.42.42.2(pid=15298): Launched 06:01:22.289409 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:22.847256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15300): Launched 06:01:23.161693 run osmo-stp_10.42.42.5(pid=15301): Launched 06:01:23.281673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:23.823269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15303): Launched 06:01:23.944021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:24.209990 run patchelf(pid=15304): Launched 06:01:24.384600 run osmo-stp_10.42.42.5(pid=15301): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15301)] 06:01:24.517736 run osmo-stp_10.42.42.5(pid=15301): stdout: | (launched: 2022-12-14_06:01:23.104317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:24.652044 run osmo-stp_10.42.42.5(pid=15301): stderr: | 20221214060123276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060123276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060123276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060123277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060123277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060123277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060123277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:24.787138 run osmo-stp_10.42.42.5(pid=15301): stdout: | (launched: 2022-12-14_06:01:23.104317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:24.915789 run osmo-stp_10.42.42.5(pid=15301): stderr: | 20221214060123276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060123276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060123276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060123277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060123277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060123277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060123277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:25.067849 run patchelf(pid=15304): Terminating (SIGINT) 06:01:25.243891 run patchelf(pid=15304): Terminated: ok {rc=0} 06:01:25.370967 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15301): Process ended prematurely: osmo-stp_10.42.42.5(pid=15301) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15301)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 06:01:25.380671 tst iperf3.py:8: Test FAILED (7.7 sec) 06:01:25.407863 run osmo-hlr_10.42.42.2(pid=15298): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15298)] 06:01:25.456215 run osmo-hlr_10.42.42.2(pid=15298): stdout: | (launched: 2022-12-14_06:01:22.111524) 06:01:25.506214 run osmo-hlr_10.42.42.2(pid=15298): stderr: | 20221214060122287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060122288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060122288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060122288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060122288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060122288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060122300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060122308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060122308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060122308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:25.556521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15293): Terminating (SIGTERM) 06:01:25.597128 run iperf3-srv_10.42.42.10(pid=15294): Terminating (SIGTERM) 06:01:25.637497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15297): Terminating (SIGTERM) 06:01:25.677565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15300): Terminating (SIGTERM) 06:01:25.717969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15303): Terminating (SIGTERM) 06:01:25.758568 --- ParallelTerminationStrategy: PID 15293 died... 06:01:25.777853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15293): Terminated: ok {rc=0} 06:01:25.823003 --- ParallelTerminationStrategy: PID 15294 died... 06:01:25.842069 run iperf3-srv_10.42.42.10(pid=15294): Terminated {rc=256} 06:01:25.886350 --- ParallelTerminationStrategy: PID 15297 died... 06:01:25.905228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15297): Terminated: ok {rc=0} 06:01:25.949431 --- ParallelTerminationStrategy: PID 15300 died... 06:01:25.968449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15300): Terminated: ok {rc=0} 06:01:26.013142 --- ParallelTerminationStrategy: PID 15303 died... 06:01:26.031957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15303): Terminated: ok {rc=0} 06:01:26.118944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:01:27.268482 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.280237 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:27.333457 tst iperf3m4.py: using LAC 38897 06:01:27.457211 tst iperf3m4.py: using RAC 137 06:01:27.581862 tst iperf3m4.py: using CellId 38897 06:01:27.704388 tst iperf3m4.py: using BVCI 38898 06:01:27.819892 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.831091 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.842041 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.853085 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.864153 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.875334 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.886658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.897867 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:27.909121 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:28.027587 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:28.151431 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:28.269853 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:28.391743 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:01:28.618895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:28.956194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15305): Launched 06:01:29.247576 run iperf3-srv_10.42.42.10(pid=15306): Launched 06:01:29.372723 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:01:29.598679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:29.936558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15307): Launched 06:01:30.227542 run iperf3-srv_10.42.42.10(pid=15308): Launched 06:01:30.353068 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:01:30.579767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:30.921797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15309): Launched 06:01:31.238089 run iperf3-srv_10.42.42.10(pid=15310): Launched 06:01:31.379162 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:01:31.609515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:31.991959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15311): Launched 06:01:32.305223 run iperf3-srv_10.42.42.10(pid=15312): Launched 06:01:32.430185 tst iperf3m4.py:8: start network... 06:01:32.656293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:33.175913 run create_hlr_db(pid=15313): Launched 06:01:33.310835 bus /gobi_6: Setting Powered False 06:01:34.376543 run create_hlr_db(pid=15313): Terminated: ok {rc=0} 06:01:34.823093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Launched 06:01:35.137769 run osmo-hlr_10.42.42.2(pid=15316): Launched 06:01:35.257095 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:35.800678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Launched 06:01:36.117078 run osmo-stp_10.42.42.5(pid=15319): Launched 06:01:36.237882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:36.781560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15321): Launched 06:01:36.902285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:37.168548 run patchelf(pid=15322): Launched 06:01:37.343017 run osmo-stp_10.42.42.5(pid=15319): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] 06:01:37.476219 run osmo-stp_10.42.42.5(pid=15319): stdout: | (launched: 2022-12-14_06:01:36.058949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:37.611477 run osmo-stp_10.42.42.5(pid=15319): stderr: | 20221214060136230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060136230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060136230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060136231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060136231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060136231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060136231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:37.746731 run osmo-stp_10.42.42.5(pid=15319): stdout: | (launched: 2022-12-14_06:01:36.058949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:37.875650 run osmo-stp_10.42.42.5(pid=15319): stderr: | 20221214060136230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060136230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060136230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060136231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060136231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060136231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060136231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:38.028072 run patchelf(pid=15322): Terminating (SIGINT) 06:01:38.204350 run patchelf(pid=15322): Terminated: ok {rc=0} 06:01:38.331481 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15319): Process ended prematurely: osmo-stp_10.42.42.5(pid=15319) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 06:01:38.341240 tst iperf3m4.py:8: Test FAILED (11.1 sec) 06:01:38.369083 run osmo-hlr_10.42.42.2(pid=15316): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15316)] 06:01:38.417889 run osmo-hlr_10.42.42.2(pid=15316): stdout: | (launched: 2022-12-14_06:01:35.080210) 06:01:38.468315 run osmo-hlr_10.42.42.2(pid=15316): stderr: | 20221214060135258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060135258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060135258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060135259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060135259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060135259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060135271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060135281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060135281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060135281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:38.519148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15305): Terminating (SIGTERM) 06:01:38.559797 run iperf3-srv_10.42.42.10(pid=15306): Terminating (SIGTERM) 06:01:38.600254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15307): Terminating (SIGTERM) 06:01:38.640823 run iperf3-srv_10.42.42.10(pid=15308): Terminating (SIGTERM) 06:01:38.682601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15309): Terminating (SIGTERM) 06:01:38.723690 run iperf3-srv_10.42.42.10(pid=15310): Terminating (SIGTERM) 06:01:38.764134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15311): Terminating (SIGTERM) 06:01:38.804437 run iperf3-srv_10.42.42.10(pid=15312): Terminating (SIGTERM) 06:01:38.846174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Terminating (SIGTERM) 06:01:38.887607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Terminating (SIGTERM) 06:01:38.928174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15321): Terminating (SIGTERM) 06:01:38.969166 --- ParallelTerminationStrategy: PID 15305 died... 06:01:38.988803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15305): Terminated: ok {rc=0} 06:01:39.033530 --- ParallelTerminationStrategy: PID 15306 died... 06:01:39.052560 run iperf3-srv_10.42.42.10(pid=15306): Terminated {rc=256} 06:01:39.096886 --- ParallelTerminationStrategy: PID 15307 died... 06:01:39.116468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15307): Terminated: ok {rc=0} 06:01:39.160727 --- ParallelTerminationStrategy: PID 15308 died... 06:01:39.179686 run iperf3-srv_10.42.42.10(pid=15308): Terminated {rc=256} 06:01:39.223982 --- ParallelTerminationStrategy: PID 15309 died... 06:01:39.243132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15309): Terminated: ok {rc=0} 06:01:39.287589 --- ParallelTerminationStrategy: PID 15310 died... 06:01:39.306766 run iperf3-srv_10.42.42.10(pid=15310): Terminated {rc=256} 06:01:39.351080 --- ParallelTerminationStrategy: PID 15311 died... 06:01:39.370161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15311): Terminated: ok {rc=0} 06:01:39.414693 --- ParallelTerminationStrategy: PID 15312 died... 06:01:39.433871 run iperf3-srv_10.42.42.10(pid=15312): Terminated {rc=256} 06:01:39.478423 --- ParallelTerminationStrategy: PID 15315 died... 06:01:39.497537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Terminated: ok {rc=0} 06:01:39.541893 --- ParallelTerminationStrategy: PID 15318 died... 06:01:39.561128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Terminated: ok {rc=0} 06:01:39.605472 --- ParallelTerminationStrategy: PID 15321 died... 06:01:39.624560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15321): Terminated: ok {rc=0} 06:01:39.712516 bus /gobi_4: Setting Powered False 06:01:40.813359 bus /gobi_4: Setting Powered False 06:01:41.930347 bus /gobi_1: Setting Powered False 06:01:43.029133 bus /gobi_1: Setting Powered False 06:01:44.146362 bus /gobi_0: Setting Powered False 06:01:45.245528 bus /gobi_0: Setting Powered False 06:01:46.374605 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 06:01:47.494687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:47.507133 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:47.560335 tst ping.py: using LAC 38898 06:01:47.693230 tst ping.py: using RAC 138 06:01:47.822455 tst ping.py: using CellId 38898 06:01:47.950952 tst ping.py: using BVCI 38899 06:01:48.071202 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.082956 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.094459 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.106007 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.117384 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.128690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.140342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:48.151862 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:48.271228 tst ping.py:19: start network... 06:01:48.493646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:49.002021 run create_hlr_db(pid=15323): Launched 06:01:49.137065 bus /gobi_6: Setting Powered False 06:01:50.201791 run create_hlr_db(pid=15323): Terminated: ok {rc=0} 06:01:50.641526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Launched 06:01:50.951455 run osmo-hlr_10.42.42.2(pid=15326): Launched 06:01:51.069056 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:51.615315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Launched 06:01:51.924130 run osmo-stp_10.42.42.5(pid=15329): Launched 06:01:52.045172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:52.583972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15331): Launched 06:01:52.701956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:52.963375 run patchelf(pid=15332): Launched 06:01:53.134819 run osmo-stp_10.42.42.5(pid=15329): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] 06:01:53.265235 run osmo-stp_10.42.42.5(pid=15329): stdout: | (launched: 2022-12-14_06:01:51.867635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:53.397575 run osmo-stp_10.42.42.5(pid=15329): stderr: | 20221214060152042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060152043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060152043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060152043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060152045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060152045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060152045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:53.530411 run osmo-stp_10.42.42.5(pid=15329): stdout: | (launched: 2022-12-14_06:01:51.867635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:53.656677 run osmo-stp_10.42.42.5(pid=15329): stderr: | 20221214060152042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060152043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060152043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060152043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060152045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060152045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060152045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:53.806493 run patchelf(pid=15332): Terminating (SIGINT) 06:01:53.978753 run patchelf(pid=15332): Terminated: ok {rc=0} 06:01:54.103535 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15329): Process ended prematurely: osmo-stp_10.42.42.5(pid=15329) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 06:01:54.112713 tst ping.py:22: Test FAILED (6.6 sec) 06:01:54.139729 run osmo-hlr_10.42.42.2(pid=15326): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15326)] 06:01:54.188276 run osmo-hlr_10.42.42.2(pid=15326): stdout: | (launched: 2022-12-14_06:01:50.895027) 06:01:54.238449 run osmo-hlr_10.42.42.2(pid=15326): stderr: | 20221214060151075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060151075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060151075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060151075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060151075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060151075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060151087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060151096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060151096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060151096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:54.289143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Terminating (SIGTERM) 06:01:54.329598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Terminating (SIGTERM) 06:01:54.370183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15331): Terminating (SIGTERM) 06:01:54.410846 --- ParallelTerminationStrategy: PID 15325 died... 06:01:54.430555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Terminated: ok {rc=0} 06:01:54.475518 --- ParallelTerminationStrategy: PID 15328 died... 06:01:54.494737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Terminated: ok {rc=0} 06:01:54.539123 --- ParallelTerminationStrategy: PID 15331 died... 06:01:54.558294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15331): Terminated: ok {rc=0} 06:01:54.645701 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:01:55.735052 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:55.747477 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:55.801733 tst ping_idle_ping.py: using LAC 38899 06:01:55.923801 tst ping_idle_ping.py: using RAC 139 06:01:56.046610 tst ping_idle_ping.py: using CellId 38899 06:01:56.176699 tst ping_idle_ping.py: using BVCI 38900 06:01:56.297538 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.309355 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.320882 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.332554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.344657 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.356680 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.368883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:56.381071 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:56.503982 tst ping_idle_ping.py:24: start network... 06:01:56.728416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:57.242303 run create_hlr_db(pid=15333): Launched 06:01:57.379655 bus /gobi_6: Setting Powered False 06:01:58.445100 run create_hlr_db(pid=15333): Terminated: ok {rc=0} 06:01:58.887598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15335): Launched 06:01:59.196718 run osmo-hlr_10.42.42.2(pid=15336): Launched 06:01:59.315574 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:59.848999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15338): Launched 06:02:00.158138 run osmo-stp_10.42.42.5(pid=15339): Launched 06:02:00.276939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:00.819237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15343): Launched 06:02:00.970177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:01.256382 run patchelf(pid=15344): Launched 06:02:01.455716 run osmo-stp_10.42.42.5(pid=15339): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15339)] 06:02:01.598399 run osmo-stp_10.42.42.5(pid=15339): stdout: | (launched: 2022-12-14_06:02:00.101550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:01.744088 run osmo-stp_10.42.42.5(pid=15339): stderr: | 20221214060200274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060200274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060200274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060200274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060200275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060200275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060200275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:01.891333 run osmo-stp_10.42.42.5(pid=15339): stdout: | (launched: 2022-12-14_06:02:00.101550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:02.029490 run osmo-stp_10.42.42.5(pid=15339): stderr: | 20221214060200274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060200274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060200274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060200274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060200275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060200275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060200275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:02.194938 run patchelf(pid=15344): Terminating (SIGINT) 06:02:02.378991 run patchelf(pid=15344): Terminated: ok {rc=0} 06:02:02.511882 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15339): Process ended prematurely: osmo-stp_10.42.42.5(pid=15339) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15339)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 06:02:02.521899 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:02:02.550395 run osmo-hlr_10.42.42.2(pid=15336): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15336)] 06:02:02.601237 run osmo-hlr_10.42.42.2(pid=15336): stdout: | (launched: 2022-12-14_06:01:59.140058) 06:02:02.653480 run osmo-hlr_10.42.42.2(pid=15336): stderr: | 20221214060159317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060159317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060159317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060159317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060159317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060159317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060159329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060159337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060159337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060159337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:02.705965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15335): Terminating (SIGTERM) 06:02:02.748230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15338): Terminating (SIGTERM) 06:02:02.790993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15343): Terminating (SIGTERM) 06:02:02.833617 --- ParallelTerminationStrategy: PID 15335 died... 06:02:02.854068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15335): Terminated: ok {rc=0} 06:02:02.900781 --- ParallelTerminationStrategy: PID 15338 died... 06:02:02.920772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15338): Terminated: ok {rc=0} 06:02:02.967503 --- ParallelTerminationStrategy: PID 15343 died... 06:02:02.987327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15343): Terminated: ok {rc=0} 06:02:03.075851 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:02:04.391911 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:02:04.398593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:02:04.433031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:02:04.472457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:02:04.562505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:02:04.596753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:02:04.634711 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:02:05.232941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:02:05.286890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.298472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:05.371463 tst cs_paging_gprs_active.py: using LAC 38900 06:02:05.503179 tst cs_paging_gprs_active.py: using RAC 140 06:02:05.638609 tst cs_paging_gprs_active.py: using CellId 38900 06:02:05.769396 tst cs_paging_gprs_active.py: using BVCI 38901 06:02:05.890355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.901854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.913185 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.924534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.935936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.947269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.958760 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.970085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:05.981656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:06.099716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:06.221774 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:02:06.447966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:06.782654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15349): Launched 06:02:07.073390 run iperf3-srv_10.42.42.10(pid=15350): Launched 06:02:07.199814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:02:07.426445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:07.762386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15351): Launched 06:02:08.053221 run iperf3-srv_10.42.42.10(pid=15352): Launched 06:02:08.179043 tst cs_paging_gprs_active.py:38: start network... 06:02:08.405341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:08.923597 run create_hlr_db(pid=15353): Launched 06:02:09.058839 bus /gobi_6: Setting Powered False 06:02:10.124704 run create_hlr_db(pid=15353): Terminated: ok {rc=0} 06:02:10.571937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15355): Launched 06:02:10.886119 run osmo-hlr_10.42.42.2(pid=15356): Launched 06:02:11.005976 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:11.557179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15358): Launched 06:02:11.870952 run osmo-stp_10.42.42.5(pid=15359): Launched 06:02:11.990907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:12.532350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15361): Launched 06:02:12.652874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:12.918676 run patchelf(pid=15362): Launched 06:02:13.094982 run osmo-stp_10.42.42.5(pid=15359): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15359)] 06:02:13.227898 run osmo-stp_10.42.42.5(pid=15359): stdout: | (launched: 2022-12-14_06:02:11.812913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:13.362571 run osmo-stp_10.42.42.5(pid=15359): stderr: | 20221214060211986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060211986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060211986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060211987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060211987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060211987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060211987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:13.497458 run osmo-stp_10.42.42.5(pid=15359): stdout: | (launched: 2022-12-14_06:02:11.812913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:13.625405 run osmo-stp_10.42.42.5(pid=15359): stderr: | 20221214060211986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060211986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060211986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060211987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060211987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060211987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060211987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:13.777394 run patchelf(pid=15362): Terminating (SIGINT) 06:02:13.953288 run patchelf(pid=15362): Terminated: ok {rc=0} 06:02:14.079927 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15359): Process ended prematurely: osmo-stp_10.42.42.5(pid=15359) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15359)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:02:14.089703 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:02:14.116606 run osmo-hlr_10.42.42.2(pid=15356): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15356)] 06:02:14.165333 run osmo-hlr_10.42.42.2(pid=15356): stdout: | (launched: 2022-12-14_06:02:10.828854) 06:02:14.215193 run osmo-hlr_10.42.42.2(pid=15356): stderr: | 20221214060211005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060211005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060211005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060211005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060211005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060211005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060211017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060211025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060211025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060211025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:14.265330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15349): Terminating (SIGTERM) 06:02:14.305508 run iperf3-srv_10.42.42.10(pid=15350): Terminating (SIGTERM) 06:02:14.345736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15351): Terminating (SIGTERM) 06:02:14.385903 run iperf3-srv_10.42.42.10(pid=15352): Terminating (SIGTERM) 06:02:14.425928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15355): Terminating (SIGTERM) 06:02:14.466047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15358): Terminating (SIGTERM) 06:02:14.506411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15361): Terminating (SIGTERM) 06:02:14.546859 --- ParallelTerminationStrategy: PID 15349 died... 06:02:14.566294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15349): Terminated: ok {rc=0} 06:02:14.611030 --- ParallelTerminationStrategy: PID 15350 died... 06:02:14.630185 run iperf3-srv_10.42.42.10(pid=15350): Terminated {rc=256} 06:02:14.674457 --- ParallelTerminationStrategy: PID 15351 died... 06:02:14.693480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15351): Terminated: ok {rc=0} 06:02:14.737605 --- ParallelTerminationStrategy: PID 15352 died... 06:02:14.756543 run iperf3-srv_10.42.42.10(pid=15352): Terminated {rc=256} 06:02:14.800455 --- ParallelTerminationStrategy: PID 15355 died... 06:02:14.819423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15355): Terminated: ok {rc=0} 06:02:14.863720 --- ParallelTerminationStrategy: PID 15358 died... 06:02:14.882864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15358): Terminated: ok {rc=0} 06:02:14.927068 --- ParallelTerminationStrategy: PID 15361 died... 06:02:14.946193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15361): Terminated: ok {rc=0} 06:02:15.032476 bus /gobi_0: Setting Powered False 06:02:16.143848 bus /gobi_0: Setting Powered False 06:02:17.275410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:02:18.421476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:18.433543 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:18.507797 tst iperf3.py: using LAC 38901 06:02:18.630825 tst iperf3.py: using RAC 141 06:02:18.754829 tst iperf3.py: using CellId 38901 06:02:18.879194 tst iperf3.py: using BVCI 38902 06:02:18.994296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.005451 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.016274 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.027123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.038549 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.050042 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.061505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.072716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:19.084351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:19.207540 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:02:19.435017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:19.771319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15363): Launched 06:02:20.065214 run iperf3-srv_10.42.42.10(pid=15364): Launched 06:02:20.191763 tst iperf3.py:8: start network... 06:02:20.419199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:20.938815 run create_hlr_db(pid=15365): Launched 06:02:21.075964 bus /gobi_6: Setting Powered False 06:02:22.142072 run create_hlr_db(pid=15365): Terminated: ok {rc=0} 06:02:22.589681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15367): Launched 06:02:22.905138 run osmo-hlr_10.42.42.2(pid=15368): Launched 06:02:23.025157 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:23.577981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15370): Launched 06:02:23.891688 run osmo-stp_10.42.42.5(pid=15371): Launched 06:02:24.011904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:24.552544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15373): Launched 06:02:24.673504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:24.939715 run patchelf(pid=15374): Launched 06:02:25.114799 run osmo-stp_10.42.42.5(pid=15371): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15371)] 06:02:25.247975 run osmo-stp_10.42.42.5(pid=15371): stdout: | (launched: 2022-12-14_06:02:23.834396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:25.383267 run osmo-stp_10.42.42.5(pid=15371): stderr: | 20221214060224006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060224006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060224007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060224007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060224007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060224008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060224008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:25.518994 run osmo-stp_10.42.42.5(pid=15371): stdout: | (launched: 2022-12-14_06:02:23.834396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:25.647906 run osmo-stp_10.42.42.5(pid=15371): stderr: | 20221214060224006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060224006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060224007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060224007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060224007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060224008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060224008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:25.801352 run patchelf(pid=15374): Terminating (SIGINT) 06:02:25.977984 run patchelf(pid=15374): Terminated: ok {rc=0} 06:02:26.105825 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15371): Process ended prematurely: osmo-stp_10.42.42.5(pid=15371) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15371)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 06:02:26.115461 tst iperf3.py:8: Test FAILED (7.7 sec) 06:02:26.142832 run osmo-hlr_10.42.42.2(pid=15368): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15368)] 06:02:26.191270 run osmo-hlr_10.42.42.2(pid=15368): stdout: | (launched: 2022-12-14_06:02:22.847081) 06:02:26.241341 run osmo-hlr_10.42.42.2(pid=15368): stderr: | 20221214060223026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060223026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060223026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060223026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060223026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060223026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060223038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060223047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060223047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060223047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:26.292257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15363): Terminating (SIGTERM) 06:02:26.332712 run iperf3-srv_10.42.42.10(pid=15364): Terminating (SIGTERM) 06:02:26.373027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15367): Terminating (SIGTERM) 06:02:26.413432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15370): Terminating (SIGTERM) 06:02:26.453747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15373): Terminating (SIGTERM) 06:02:26.494223 --- ParallelTerminationStrategy: PID 15363 died... 06:02:26.513806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15363): Terminated: ok {rc=0} 06:02:26.558817 --- ParallelTerminationStrategy: PID 15364 died... 06:02:26.577886 run iperf3-srv_10.42.42.10(pid=15364): Terminated {rc=256} 06:02:26.622037 --- ParallelTerminationStrategy: PID 15367 died... 06:02:26.641191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15367): Terminated: ok {rc=0} 06:02:26.685582 --- ParallelTerminationStrategy: PID 15370 died... 06:02:26.704626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15370): Terminated: ok {rc=0} 06:02:26.749082 --- ParallelTerminationStrategy: PID 15373 died... 06:02:26.768281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15373): Terminated: ok {rc=0} 06:02:26.853263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:02:28.005537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.019401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:28.098275 tst iperf3m4.py: using LAC 38902 06:02:28.227859 tst iperf3m4.py: using RAC 142 06:02:28.358756 tst iperf3m4.py: using CellId 38902 06:02:28.487674 tst iperf3m4.py: using BVCI 38903 06:02:28.608528 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.620268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.631675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.643107 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.654466 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.665954 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.677578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.688754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:28.700339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:28.822197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:28.942808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:29.062017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:29.183472 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:02:29.410636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:29.746965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15375): Launched 06:02:30.039183 run iperf3-srv_10.42.42.10(pid=15376): Launched 06:02:30.166278 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:02:30.393880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:30.730843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15377): Launched 06:02:31.039640 run iperf3-srv_10.42.42.10(pid=15378): Launched 06:02:31.173281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:02:31.403979 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:31.746884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15379): Launched 06:02:32.053697 run iperf3-srv_10.42.42.10(pid=15380): Launched 06:02:32.190256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:02:32.406917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:32.724540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15381): Launched 06:02:32.998742 run iperf3-srv_10.42.42.10(pid=15382): Launched 06:02:33.118733 tst iperf3m4.py:8: start network... 06:02:33.329588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:33.815359 run create_hlr_db(pid=15383): Launched 06:02:33.935607 bus /gobi_6: Setting Powered False 06:02:34.997625 run create_hlr_db(pid=15383): Terminated: ok {rc=0} 06:02:35.435220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15385): Launched 06:02:35.751726 run osmo-hlr_10.42.42.2(pid=15386): Launched 06:02:35.872312 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:36.417234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15388): Launched 06:02:36.730726 run osmo-stp_10.42.42.5(pid=15389): Launched 06:02:36.852132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:37.395065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15391): Launched 06:02:37.517699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:37.784569 run patchelf(pid=15392): Launched 06:02:37.959113 run osmo-stp_10.42.42.5(pid=15389): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15389)] 06:02:38.091951 run osmo-stp_10.42.42.5(pid=15389): stdout: | (launched: 2022-12-14_06:02:36.673434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:38.226861 run osmo-stp_10.42.42.5(pid=15389): stderr: | 20221214060236843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060236843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060236843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060236844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060236845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060236845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060236845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:38.362442 run osmo-stp_10.42.42.5(pid=15389): stdout: | (launched: 2022-12-14_06:02:36.673434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:38.491444 run osmo-stp_10.42.42.5(pid=15389): stderr: | 20221214060236843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060236843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060236843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060236844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060236845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060236845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060236845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:38.643747 run patchelf(pid=15392): Terminating (SIGINT) 06:02:38.819468 run patchelf(pid=15392): Terminated: ok {rc=0} 06:02:38.945977 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15389): Process ended prematurely: osmo-stp_10.42.42.5(pid=15389) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15389)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:02:38.955695 tst iperf3m4.py:8: Test FAILED (11.0 sec) 06:02:38.983211 run osmo-hlr_10.42.42.2(pid=15386): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15386)] 06:02:39.031910 run osmo-hlr_10.42.42.2(pid=15386): stdout: | (launched: 2022-12-14_06:02:35.694025) 06:02:39.082024 run osmo-hlr_10.42.42.2(pid=15386): stderr: | 20221214060235871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060235871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060235871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060235871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060235871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060235871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060235888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060235897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060235898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060235898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:39.132541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15375): Terminating (SIGTERM) 06:02:39.173155 run iperf3-srv_10.42.42.10(pid=15376): Terminating (SIGTERM) 06:02:39.213712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15377): Terminating (SIGTERM) 06:02:39.254207 run iperf3-srv_10.42.42.10(pid=15378): Terminating (SIGTERM) 06:02:39.294447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15379): Terminating (SIGTERM) 06:02:39.335065 run iperf3-srv_10.42.42.10(pid=15380): Terminating (SIGTERM) 06:02:39.375322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15381): Terminating (SIGTERM) 06:02:39.415600 run iperf3-srv_10.42.42.10(pid=15382): Terminating (SIGTERM) 06:02:39.455994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15385): Terminating (SIGTERM) 06:02:39.496432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15388): Terminating (SIGTERM) 06:02:39.536838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15391): Terminating (SIGTERM) 06:02:39.577447 --- ParallelTerminationStrategy: PID 15375 died... 06:02:39.597194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15375): Terminated: ok {rc=0} 06:02:39.641925 --- ParallelTerminationStrategy: PID 15376 died... 06:02:39.661070 run iperf3-srv_10.42.42.10(pid=15376): Terminated {rc=256} 06:02:39.705537 --- ParallelTerminationStrategy: PID 15377 died... 06:02:39.724553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15377): Terminated: ok {rc=0} 06:02:39.769495 --- ParallelTerminationStrategy: PID 15378 died... 06:02:39.788642 run iperf3-srv_10.42.42.10(pid=15378): Terminated {rc=256} 06:02:39.833199 --- ParallelTerminationStrategy: PID 15379 died... 06:02:39.852151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15379): Terminated: ok {rc=0} 06:02:39.896871 --- ParallelTerminationStrategy: PID 15380 died... 06:02:39.916539 run iperf3-srv_10.42.42.10(pid=15380): Terminated {rc=256} 06:02:39.960916 --- ParallelTerminationStrategy: PID 15381 died... 06:02:39.980130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15381): Terminated: ok {rc=0} 06:02:40.024800 --- ParallelTerminationStrategy: PID 15382 died... 06:02:40.044476 run iperf3-srv_10.42.42.10(pid=15382): Terminated {rc=256} 06:02:40.088714 --- ParallelTerminationStrategy: PID 15385 died... 06:02:40.108005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15385): Terminated: ok {rc=0} 06:02:40.152605 --- ParallelTerminationStrategy: PID 15388 died... 06:02:40.171808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15388): Terminated: ok {rc=0} 06:02:40.216380 --- ParallelTerminationStrategy: PID 15391 died... 06:02:40.235690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15391): Terminated: ok {rc=0} 06:02:40.321114 bus /gobi_4: Setting Powered False 06:02:41.420403 bus /gobi_4: Setting Powered False 06:02:42.540090 bus /gobi_1: Setting Powered False 06:02:43.639380 bus /gobi_1: Setting Powered False 06:02:44.754409 bus /gobi_0: Setting Powered False 06:02:45.869139 bus /gobi_0: Setting Powered False 06:02:46.996850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:02:48.099869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.112018 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:48.184792 tst ping.py: using LAC 38903 06:02:48.308253 tst ping.py: using RAC 143 06:02:48.430687 tst ping.py: using CellId 38903 06:02:48.555232 tst ping.py: using BVCI 38904 06:02:48.677575 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.689214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.700600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.712029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.723343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.734765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.746255 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:48.757579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:48.874835 tst ping.py:19: start network... 06:02:49.082790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:49.560369 run create_hlr_db(pid=15393): Launched 06:02:49.679463 bus /gobi_6: Setting Powered False 06:02:50.740255 run create_hlr_db(pid=15393): Terminated: ok {rc=0} 06:02:51.170959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15395): Launched 06:02:51.480315 run osmo-hlr_10.42.42.2(pid=15396): Launched 06:02:51.599611 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:52.148121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15398): Launched 06:02:52.455772 run osmo-stp_10.42.42.5(pid=15399): Launched 06:02:52.576838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:53.109140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15401): Launched 06:02:53.227084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:53.488425 run patchelf(pid=15402): Launched 06:02:53.661067 run osmo-stp_10.42.42.5(pid=15399): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15399)] 06:02:53.791509 run osmo-stp_10.42.42.5(pid=15399): stdout: | (launched: 2022-12-14_06:02:52.399390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:53.924006 run osmo-stp_10.42.42.5(pid=15399): stderr: | 20221214060252571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060252571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060252572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060252572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060252573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060252573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060252573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:54.056565 run osmo-stp_10.42.42.5(pid=15399): stdout: | (launched: 2022-12-14_06:02:52.399390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:54.182713 run osmo-stp_10.42.42.5(pid=15399): stderr: | 20221214060252571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060252571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060252572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060252572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060252573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060252573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060252573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:54.332090 run patchelf(pid=15402): Terminating (SIGINT) 06:02:54.505418 run patchelf(pid=15402): Terminated: ok {rc=0} 06:02:54.629817 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15399): Process ended prematurely: osmo-stp_10.42.42.5(pid=15399) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15399)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 06:02:54.638870 tst ping.py:22: Test FAILED (6.5 sec) 06:02:54.665958 run osmo-hlr_10.42.42.2(pid=15396): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15396)] 06:02:54.714979 run osmo-hlr_10.42.42.2(pid=15396): stdout: | (launched: 2022-12-14_06:02:51.423652) 06:02:54.765270 run osmo-hlr_10.42.42.2(pid=15396): stderr: | 20221214060251601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060251601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060251601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060251601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060251601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060251602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060251613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060251621 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060251621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060251622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:54.815893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15395): Terminating (SIGTERM) 06:02:54.856680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15398): Terminating (SIGTERM) 06:02:54.897619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15401): Terminating (SIGTERM) 06:02:54.938641 --- ParallelTerminationStrategy: PID 15395 died... 06:02:54.958475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15395): Terminated: ok {rc=0} 06:02:55.003203 --- ParallelTerminationStrategy: PID 15398 died... 06:02:55.022526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15398): Terminated: ok {rc=0} 06:02:55.067486 --- ParallelTerminationStrategy: PID 15401 died... 06:02:55.086687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15401): Terminated: ok {rc=0} 06:02:55.171620 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:02:56.257053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.269236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:56.341409 tst ping_idle_ping.py: using LAC 38904 06:02:56.467081 tst ping_idle_ping.py: using RAC 144 06:02:56.588602 tst ping_idle_ping.py: using CellId 38904 06:02:56.708407 tst ping_idle_ping.py: using BVCI 38905 06:02:56.820855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.832356 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.843462 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.854595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.865992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.877559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.889054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:56.900330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:57.021171 tst ping_idle_ping.py:24: start network... 06:02:57.244771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:57.764474 run create_hlr_db(pid=15403): Launched 06:02:57.900062 bus /gobi_6: Setting Powered False 06:02:58.965868 run create_hlr_db(pid=15403): Terminated: ok {rc=0} 06:02:59.407631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15405): Launched 06:02:59.718477 run osmo-hlr_10.42.42.2(pid=15406): Launched 06:02:59.836801 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:00.380467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15408): Launched 06:03:00.689212 run osmo-stp_10.42.42.5(pid=15409): Launched 06:03:00.806714 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:01.451972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15412): Launched 06:03:01.611289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:01.941419 run patchelf(pid=15413): Launched 06:03:02.142009 run osmo-stp_10.42.42.5(pid=15409): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15409)] 06:03:02.284491 run osmo-stp_10.42.42.5(pid=15409): stdout: | (launched: 2022-12-14_06:03:00.632686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:02.425146 run osmo-stp_10.42.42.5(pid=15409): stderr: | 20221214060300805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060300805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060300806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060300806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060300806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060300807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060300807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:02.566305 run osmo-stp_10.42.42.5(pid=15409): stdout: | (launched: 2022-12-14_06:03:00.632686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:02.700490 run osmo-stp_10.42.42.5(pid=15409): stderr: | 20221214060300805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060300805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060300806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060300806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060300806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060300807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060300807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:02.859982 run patchelf(pid=15413): Terminating (SIGINT) 06:03:03.043106 run patchelf(pid=15413): Terminated: ok {rc=0} 06:03:03.174944 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15409): Process ended prematurely: osmo-stp_10.42.42.5(pid=15409) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15409)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:03:03.184712 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 06:03:03.212846 run osmo-hlr_10.42.42.2(pid=15406): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15406)] 06:03:03.262867 run osmo-hlr_10.42.42.2(pid=15406): stdout: | (launched: 2022-12-14_06:02:59.660873) 06:03:03.314712 run osmo-hlr_10.42.42.2(pid=15406): stderr: | 20221214060259837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060259837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060259837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060259837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060259837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060259837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060259854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060259863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060259864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060259864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:03.367166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15405): Terminating (SIGTERM) 06:03:03.408986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15408): Terminating (SIGTERM) 06:03:03.451381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15412): Terminating (SIGTERM) 06:03:03.493984 --- ParallelTerminationStrategy: PID 15405 died... 06:03:03.514198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15405): Terminated: ok {rc=0} 06:03:03.560267 --- ParallelTerminationStrategy: PID 15408 died... 06:03:03.579901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15408): Terminated: ok {rc=0} 06:03:03.626024 --- ParallelTerminationStrategy: PID 15412 died... 06:03:03.645581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15412): Terminated: ok {rc=0} 06:03:03.733840 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:03:05.046817 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:05.053499 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:03:05.088024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:03:05.127934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:03:05.218615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:03:05.251769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:03:05.289860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:03:05.890999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:03:05.944798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:05.956541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:06.029550 tst cs_paging_gprs_active.py: using LAC 38905 06:03:06.161300 tst cs_paging_gprs_active.py: using RAC 145 06:03:06.291605 tst cs_paging_gprs_active.py: using CellId 38905 06:03:06.423963 tst cs_paging_gprs_active.py: using BVCI 38906 06:03:06.544467 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.556118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.567646 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.579414 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.591024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.602409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.614009 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.625411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:06.636880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:06.755575 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:06.874709 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:03:07.097156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:07.411623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15418): Launched 06:03:07.687087 run iperf3-srv_10.42.42.10(pid=15419): Launched 06:03:07.805309 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:03:08.016504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:08.331992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15420): Launched 06:03:08.606395 run iperf3-srv_10.42.42.10(pid=15421): Launched 06:03:08.724494 tst cs_paging_gprs_active.py:38: start network... 06:03:08.935542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:09.422106 run create_hlr_db(pid=15422): Launched 06:03:09.544413 bus /gobi_6: Setting Powered False 06:03:10.606782 run create_hlr_db(pid=15422): Terminated: ok {rc=0} 06:03:11.043746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15424): Launched 06:03:11.358009 run osmo-hlr_10.42.42.2(pid=15425): Launched 06:03:11.477956 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:12.017198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15427): Launched 06:03:12.331143 run osmo-stp_10.42.42.5(pid=15428): Launched 06:03:12.452362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:12.994159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15430): Launched 06:03:13.114703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:13.380383 run patchelf(pid=15431): Launched 06:03:13.555081 run osmo-stp_10.42.42.5(pid=15428): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15428)] 06:03:13.688088 run osmo-stp_10.42.42.5(pid=15428): stdout: | (launched: 2022-12-14_06:03:12.273774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:13.823285 run osmo-stp_10.42.42.5(pid=15428): stderr: | 20221214060312446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060312446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060312447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060312447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060312447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060312448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060312448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:13.958361 run osmo-stp_10.42.42.5(pid=15428): stdout: | (launched: 2022-12-14_06:03:12.273774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:14.086989 run osmo-stp_10.42.42.5(pid=15428): stderr: | 20221214060312446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060312446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060312447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060312447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060312447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060312448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060312448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:14.239241 run patchelf(pid=15431): Terminating (SIGINT) 06:03:14.415496 run patchelf(pid=15431): Terminated: ok {rc=0} 06:03:14.542631 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15428): Process ended prematurely: osmo-stp_10.42.42.5(pid=15428) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15428)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:03:14.552268 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:03:14.579390 run osmo-hlr_10.42.42.2(pid=15425): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15425)] 06:03:14.627581 run osmo-hlr_10.42.42.2(pid=15425): stdout: | (launched: 2022-12-14_06:03:11.300187) 06:03:14.677695 run osmo-hlr_10.42.42.2(pid=15425): stderr: | 20221214060311480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060311480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060311480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060311480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060311480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060311481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060311493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060311501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060311502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060311502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:14.727647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15418): Terminating (SIGTERM) 06:03:14.767841 run iperf3-srv_10.42.42.10(pid=15419): Terminating (SIGTERM) 06:03:14.807740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15420): Terminating (SIGTERM) 06:03:14.847717 run iperf3-srv_10.42.42.10(pid=15421): Terminating (SIGTERM) 06:03:14.887456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15424): Terminating (SIGTERM) 06:03:14.927157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15427): Terminating (SIGTERM) 06:03:14.966930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15430): Terminating (SIGTERM) 06:03:15.006941 --- ParallelTerminationStrategy: PID 15418 died... 06:03:15.026466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15418): Terminated: ok {rc=0} 06:03:15.070725 --- ParallelTerminationStrategy: PID 15419 died... 06:03:15.089741 run iperf3-srv_10.42.42.10(pid=15419): Terminated {rc=256} 06:03:15.133796 --- ParallelTerminationStrategy: PID 15420 died... 06:03:15.152837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15420): Terminated: ok {rc=0} 06:03:15.196591 --- ParallelTerminationStrategy: PID 15421 died... 06:03:15.215510 run iperf3-srv_10.42.42.10(pid=15421): Terminated {rc=256} 06:03:15.259392 --- ParallelTerminationStrategy: PID 15424 died... 06:03:15.278335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15424): Terminated: ok {rc=0} 06:03:15.323224 --- ParallelTerminationStrategy: PID 15427 died... 06:03:15.342233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15427): Terminated: ok {rc=0} 06:03:15.386332 --- ParallelTerminationStrategy: PID 15430 died... 06:03:15.405394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15430): Terminated: ok {rc=0} 06:03:15.491616 bus /gobi_0: Setting Powered False 06:03:16.602738 bus /gobi_0: Setting Powered False 06:03:17.732985 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:03:18.883221 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:18.895434 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:18.971301 tst iperf3.py: using LAC 38906 06:03:19.103540 tst iperf3.py: using RAC 146 06:03:19.234848 tst iperf3.py: using CellId 38906 06:03:19.365446 tst iperf3.py: using BVCI 38907 06:03:19.480776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.492092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.503300 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.514500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.525957 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.537263 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.548579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.559802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:19.571117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:19.692635 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:03:19.920703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:20.257611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15432): Launched 06:03:20.550539 run iperf3-srv_10.42.42.10(pid=15433): Launched 06:03:20.676828 tst iperf3.py:8: start network... 06:03:20.905170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:21.425132 run create_hlr_db(pid=15434): Launched 06:03:21.561997 bus /gobi_6: Setting Powered False 06:03:22.627436 run create_hlr_db(pid=15434): Terminated: ok {rc=0} 06:03:23.074143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15436): Launched 06:03:23.389981 run osmo-hlr_10.42.42.2(pid=15437): Launched 06:03:23.509508 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:24.067459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15439): Launched 06:03:24.382203 run osmo-stp_10.42.42.5(pid=15440): Launched 06:03:24.501587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:25.044469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15442): Launched 06:03:25.165515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:25.432407 run patchelf(pid=15443): Launched 06:03:25.606927 run osmo-stp_10.42.42.5(pid=15440): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15440)] 06:03:25.739740 run osmo-stp_10.42.42.5(pid=15440): stdout: | (launched: 2022-12-14_06:03:24.324642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:25.874953 run osmo-stp_10.42.42.5(pid=15440): stderr: | 20221214060324497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060324497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060324497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060324497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060324498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060324498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060324498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:26.009800 run osmo-stp_10.42.42.5(pid=15440): stdout: | (launched: 2022-12-14_06:03:24.324642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:26.138396 run osmo-stp_10.42.42.5(pid=15440): stderr: | 20221214060324497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060324497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060324497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060324497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060324498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060324498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060324498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:26.290817 run patchelf(pid=15443): Terminating (SIGINT) 06:03:26.467241 run patchelf(pid=15443): Terminated: ok {rc=0} 06:03:26.594806 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15440): Process ended prematurely: osmo-stp_10.42.42.5(pid=15440) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15440)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 06:03:26.604422 tst iperf3.py:8: Test FAILED (7.8 sec) 06:03:26.631971 run osmo-hlr_10.42.42.2(pid=15437): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15437)] 06:03:26.681121 run osmo-hlr_10.42.42.2(pid=15437): stdout: | (launched: 2022-12-14_06:03:23.332681) 06:03:26.731465 run osmo-hlr_10.42.42.2(pid=15437): stderr: | 20221214060323511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060323511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060323511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060323511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060323511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060323511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060323523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060323531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060323531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060323531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:26.782121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15432): Terminating (SIGTERM) 06:03:26.822744 run iperf3-srv_10.42.42.10(pid=15433): Terminating (SIGTERM) 06:03:26.863233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15436): Terminating (SIGTERM) 06:03:26.903709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15439): Terminating (SIGTERM) 06:03:26.943974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15442): Terminating (SIGTERM) 06:03:26.984782 --- ParallelTerminationStrategy: PID 15432 died... 06:03:27.004201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15432): Terminated: ok {rc=0} 06:03:27.048596 --- ParallelTerminationStrategy: PID 15433 died... 06:03:27.067486 run iperf3-srv_10.42.42.10(pid=15433): Terminated {rc=256} 06:03:27.111493 --- ParallelTerminationStrategy: PID 15436 died... 06:03:27.130450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15436): Terminated: ok {rc=0} 06:03:27.187381 --- ParallelTerminationStrategy: PID 15439 died... 06:03:27.205653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15439): Terminated: ok {rc=0} 06:03:27.248785 --- ParallelTerminationStrategy: PID 15442 died... 06:03:27.267314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15442): Terminated: ok {rc=0} 06:03:27.350407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:03:28.499256 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:28.511499 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:28.587023 tst iperf3m4.py: using LAC 38907 06:03:28.718356 tst iperf3m4.py: using RAC 147 06:03:28.846053 tst iperf3m4.py: using CellId 38907 06:03:28.973942 tst iperf3m4.py: using BVCI 38908 06:03:29.091999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.103609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.115023 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.126526 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.138059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.149468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.160837 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.172517 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:29.184183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:29.303823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:29.422403 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:29.542950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:29.659421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:03:29.865742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:30.173828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15444): Launched 06:03:30.440230 run iperf3-srv_10.42.42.10(pid=15445): Launched 06:03:30.555323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:03:30.759990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:31.108680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15446): Launched 06:03:31.410440 run iperf3-srv_10.42.42.10(pid=15447): Launched 06:03:31.550302 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:03:31.777759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:32.153795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15448): Launched 06:03:32.442058 run iperf3-srv_10.42.42.10(pid=15449): Launched 06:03:32.564999 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:03:32.786120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:03:33.115467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15450): Launched 06:03:33.399033 run iperf3-srv_10.42.42.10(pid=15451): Launched 06:03:33.521060 tst iperf3m4.py:8: start network... 06:03:33.741109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:34.248479 run create_hlr_db(pid=15452): Launched 06:03:34.381315 bus /gobi_6: Setting Powered False 06:03:35.445559 run create_hlr_db(pid=15452): Terminated: ok {rc=0} 06:03:35.881393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15454): Launched 06:03:36.187457 run osmo-hlr_10.42.42.2(pid=15455): Launched 06:03:36.304124 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:36.845676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15457): Launched 06:03:37.150181 run osmo-stp_10.42.42.5(pid=15458): Launched 06:03:37.266138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:37.803500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15460): Launched 06:03:37.921985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:38.181024 run patchelf(pid=15461): Launched 06:03:38.354210 run osmo-stp_10.42.42.5(pid=15458): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15458)] 06:03:38.486150 run osmo-stp_10.42.42.5(pid=15458): stdout: | (launched: 2022-12-14_06:03:37.094717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:38.619899 run osmo-stp_10.42.42.5(pid=15458): stderr: | 20221214060337263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060337263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060337263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060337264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060337264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060337264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060337264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:38.753679 run osmo-stp_10.42.42.5(pid=15458): stdout: | (launched: 2022-12-14_06:03:37.094717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:38.881582 run osmo-stp_10.42.42.5(pid=15458): stderr: | 20221214060337263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060337263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060337263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060337264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060337264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060337264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060337264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:39.032454 run patchelf(pid=15461): Terminating (SIGINT) 06:03:39.206970 run patchelf(pid=15461): Terminated: ok {rc=0} 06:03:39.333285 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15458): Process ended prematurely: osmo-stp_10.42.42.5(pid=15458) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15458)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:03:39.342966 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:03:39.370463 run osmo-hlr_10.42.42.2(pid=15455): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15455)] 06:03:39.418936 run osmo-hlr_10.42.42.2(pid=15455): stdout: | (launched: 2022-12-14_06:03:36.131343) 06:03:39.469484 run osmo-hlr_10.42.42.2(pid=15455): stderr: | 20221214060336304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060336304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060336304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060336304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060336304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060336304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060336317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060336325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060336325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060336326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:39.519821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15444): Terminating (SIGTERM) 06:03:39.560575 run iperf3-srv_10.42.42.10(pid=15445): Terminating (SIGTERM) 06:03:39.601198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15446): Terminating (SIGTERM) 06:03:39.641895 run iperf3-srv_10.42.42.10(pid=15447): Terminating (SIGTERM) 06:03:39.682409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15448): Terminating (SIGTERM) 06:03:39.723327 run iperf3-srv_10.42.42.10(pid=15449): Terminating (SIGTERM) 06:03:39.763498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15450): Terminating (SIGTERM) 06:03:39.803949 run iperf3-srv_10.42.42.10(pid=15451): Terminating (SIGTERM) 06:03:39.844377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15454): Terminating (SIGTERM) 06:03:39.884865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15457): Terminating (SIGTERM) 06:03:39.925427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15460): Terminating (SIGTERM) 06:03:39.966102 --- ParallelTerminationStrategy: PID 15444 died... 06:03:39.985934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15444): Terminated: ok {rc=0} 06:03:40.030737 --- ParallelTerminationStrategy: PID 15445 died... 06:03:40.049921 run iperf3-srv_10.42.42.10(pid=15445): Terminated {rc=256} 06:03:40.094025 --- ParallelTerminationStrategy: PID 15446 died... 06:03:40.113165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15446): Terminated: ok {rc=0} 06:03:40.157673 --- ParallelTerminationStrategy: PID 15447 died... 06:03:40.176752 run iperf3-srv_10.42.42.10(pid=15447): Terminated {rc=256} 06:03:40.221324 --- ParallelTerminationStrategy: PID 15448 died... 06:03:40.240387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15448): Terminated: ok {rc=0} 06:03:40.284844 --- ParallelTerminationStrategy: PID 15449 died... 06:03:40.304451 run iperf3-srv_10.42.42.10(pid=15449): Terminated {rc=256} 06:03:40.348858 --- ParallelTerminationStrategy: PID 15450 died... 06:03:40.368381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15450): Terminated: ok {rc=0} 06:03:40.412931 --- ParallelTerminationStrategy: PID 15451 died... 06:03:40.431857 run iperf3-srv_10.42.42.10(pid=15451): Terminated {rc=256} 06:03:40.476030 --- ParallelTerminationStrategy: PID 15454 died... 06:03:40.495186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15454): Terminated: ok {rc=0} 06:03:40.539289 --- ParallelTerminationStrategy: PID 15457 died... 06:03:40.558306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15457): Terminated: ok {rc=0} 06:03:40.602244 --- ParallelTerminationStrategy: PID 15460 died... 06:03:40.621358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15460): Terminated: ok {rc=0} 06:03:40.707271 bus /gobi_4: Setting Powered False 06:03:41.806201 bus /gobi_4: Setting Powered False 06:03:42.920147 bus /gobi_1: Setting Powered False 06:03:44.019735 bus /gobi_1: Setting Powered False 06:03:45.136740 bus /gobi_0: Setting Powered False 06:03:46.236242 bus /gobi_0: Setting Powered False 06:03:47.354134 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:03:48.456906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:48.468794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:48.540380 tst ping.py: using LAC 38908 06:03:48.659995 tst ping.py: using RAC 148 06:03:48.780197 tst ping.py: using CellId 38908 06:03:48.904710 tst ping.py: using BVCI 38909 06:03:49.018651 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.029879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.040717 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.051632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.062677 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.073864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.085097 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:49.096188 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:49.211779 tst ping.py:19: start network... 06:03:49.416422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:49.888613 run create_hlr_db(pid=15462): Launched 06:03:50.005136 bus /gobi_6: Setting Powered False 06:03:51.069741 run create_hlr_db(pid=15462): Terminated: ok {rc=0} 06:03:51.523384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15464): Launched 06:03:51.850570 run osmo-hlr_10.42.42.2(pid=15465): Launched 06:03:51.975647 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:52.542816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15467): Launched 06:03:52.867236 run osmo-stp_10.42.42.5(pid=15468): Launched 06:03:52.992263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:53.553578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15470): Launched 06:03:53.677715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:53.952495 run patchelf(pid=15471): Launched 06:03:54.132612 run osmo-stp_10.42.42.5(pid=15468): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15468)] 06:03:54.269853 run osmo-stp_10.42.42.5(pid=15468): stdout: | (launched: 2022-12-14_06:03:52.807854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:54.409250 run osmo-stp_10.42.42.5(pid=15468): stderr: | 20221214060352998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060352998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060352999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060352999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060352999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060352999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060352999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:54.548093 run osmo-stp_10.42.42.5(pid=15468): stdout: | (launched: 2022-12-14_06:03:52.807854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:54.680911 run osmo-stp_10.42.42.5(pid=15468): stderr: | 20221214060352998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060352998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060352999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060352999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060352999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060352999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060352999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:54.838221 run patchelf(pid=15471): Terminating (SIGINT) 06:03:55.020296 run patchelf(pid=15471): Terminated: ok {rc=0} 06:03:55.151605 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15468): Process ended prematurely: osmo-stp_10.42.42.5(pid=15468) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15468)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 06:03:55.161173 tst ping.py:22: Test FAILED (6.7 sec) 06:03:55.189203 run osmo-hlr_10.42.42.2(pid=15465): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15465)] 06:03:55.238952 run osmo-hlr_10.42.42.2(pid=15465): stdout: | (launched: 2022-12-14_06:03:51.790207) 06:03:55.290627 run osmo-hlr_10.42.42.2(pid=15465): stderr: | 20221214060351987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060351987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060351987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060351987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060351987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060351987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060351999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060352007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060352008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060352008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:55.342646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15464): Terminating (SIGTERM) 06:03:55.384437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15467): Terminating (SIGTERM) 06:03:55.426294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15470): Terminating (SIGTERM) 06:03:55.468279 --- ParallelTerminationStrategy: PID 15464 died... 06:03:55.488239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15464): Terminated: ok {rc=0} 06:03:55.534265 --- ParallelTerminationStrategy: PID 15467 died... 06:03:55.553889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15467): Terminated: ok {rc=0} 06:03:55.599957 --- ParallelTerminationStrategy: PID 15470 died... 06:03:55.619584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15470): Terminated: ok {rc=0} 06:03:55.707450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:03:56.794017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:56.806235 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:56.880739 tst ping_idle_ping.py: using LAC 38909 06:03:57.010570 tst ping_idle_ping.py: using RAC 149 06:03:57.140050 tst ping_idle_ping.py: using CellId 38909 06:03:57.267322 tst ping_idle_ping.py: using BVCI 38910 06:03:57.386234 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.397870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.409190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.420474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.431804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.443141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.454749 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:57.466126 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:57.581864 tst ping_idle_ping.py:24: start network... 06:03:57.788073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:58.266559 run create_hlr_db(pid=15472): Launched 06:03:58.383326 bus /gobi_6: Setting Powered False 06:03:59.444108 run create_hlr_db(pid=15472): Terminated: ok {rc=0} 06:03:59.888379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15474): Launched 06:04:00.213040 run osmo-hlr_10.42.42.2(pid=15475): Launched 06:04:00.336790 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:00.932144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15477): Launched 06:04:01.277788 run osmo-stp_10.42.42.5(pid=15478): Launched 06:04:01.459484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:04:02.142050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15480): Launched 06:04:02.272115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:04:02.532432 run patchelf(pid=15481): Launched 06:04:02.702140 run osmo-stp_10.42.42.5(pid=15478): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15478)] 06:04:02.831416 run osmo-stp_10.42.42.5(pid=15478): stdout: | (launched: 2022-12-14_06:04:01.210058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:02.962529 run osmo-stp_10.42.42.5(pid=15478): stderr: | 20221214060401535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060401535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060401536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060401536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060401538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060401539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060401540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:03.094385 run osmo-stp_10.42.42.5(pid=15478): stdout: | (launched: 2022-12-14_06:04:01.210058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:03.219568 run osmo-stp_10.42.42.5(pid=15478): stderr: | 20221214060401535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060401535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060401536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060401536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060401538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060401539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060401540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:03.367489 run patchelf(pid=15481): Terminating (SIGINT) 06:04:03.537487 run patchelf(pid=15481): Terminated: ok {rc=0} 06:04:03.661082 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15478): Process ended prematurely: osmo-stp_10.42.42.5(pid=15478) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15478)] [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:04:03.670268 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 06:04:03.696675 run osmo-hlr_10.42.42.2(pid=15475): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15475)] 06:04:03.745664 run osmo-hlr_10.42.42.2(pid=15475): stdout: | (launched: 2022-12-14_06:04:00.153755) 06:04:03.795208 run osmo-hlr_10.42.42.2(pid=15475): stderr: | 20221214060400350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060400350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060400350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060400350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060400350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060400350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060400363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060400371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060400371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060400371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:03.845667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15474): Terminating (SIGTERM) 06:04:03.886252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15477): Terminating (SIGTERM) 06:04:03.926593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15480): Terminating (SIGTERM) 06:04:03.967225 --- ParallelTerminationStrategy: PID 15474 died... 06:04:03.987140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15474): Terminated: ok {rc=0} 06:04:04.032040 --- ParallelTerminationStrategy: PID 15477 died... 06:04:04.051572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15477): Terminated: ok {rc=0} 06:04:04.095994 --- ParallelTerminationStrategy: PID 15480 died... 06:04:04.115412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15480): Terminated: ok {rc=0} 06:04:04.202635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:04:05.509544 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:05.516172 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:04:05.549063 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:04:05.584502 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:04:05.635235 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:04:05.668332 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:04:05.702744 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:04:06.263643 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:04:06.268827 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.280527 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:04:06.350070 tst switch_tch_pdch.py: using LAC 38910 06:04:06.469176 tst switch_tch_pdch.py: using RAC 150 06:04:06.590701 tst switch_tch_pdch.py: using CellId 38910 06:04:06.708537 tst switch_tch_pdch.py: using BVCI 38911 06:04:06.818259 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.829634 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.840556 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.851647 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.863001 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.874325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.885839 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:04:06.897231 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:04:07.018475 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:04:07.140107 tst switch_tch_pdch.py:51: start network... 06:04:07.359280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:07.861416 run create_hlr_db(pid=15487): Launched 06:04:07.992538 bus /gobi_6: Setting Powered False 06:04:09.056810 run create_hlr_db(pid=15487): Terminated: ok {rc=0} 06:04:09.507876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15489): Launched 06:04:09.830575 run osmo-hlr_10.42.42.2(pid=15490): Launched 06:04:09.954240 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:10.517555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15492): Launched 06:04:10.839362 run osmo-stp_10.42.42.5(pid=15493): Launched 06:04:10.963236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:04:11.521795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15495): Launched 06:04:11.645422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:04:11.918344 run patchelf(pid=15496): Launched 06:04:12.097233 run osmo-stp_10.42.42.5(pid=15493): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15493)] 06:04:12.233647 run osmo-stp_10.42.42.5(pid=15493): stdout: | (launched: 2022-12-14_06:04:10.780758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:12.371791 run osmo-stp_10.42.42.5(pid=15493): stderr: | 20221214060410970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060410970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060410970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060410971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060410972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060410972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060410972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:12.510371 run osmo-stp_10.42.42.5(pid=15493): stdout: | (launched: 2022-12-14_06:04:10.780758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:12.642203 run osmo-stp_10.42.42.5(pid=15493): stderr: | 20221214060410970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060410970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060410970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060410971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060410972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060410972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060410972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:12.798473 run patchelf(pid=15496): Terminating (SIGINT) 06:04:12.978851 run patchelf(pid=15496): Terminated: ok {rc=0} 06:04:13.108475 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15493): Process ended prematurely: osmo-stp_10.42.42.5(pid=15493) [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15493)] [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:04:13.118360 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:04:13.146072 run osmo-hlr_10.42.42.2(pid=15490): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15490)] 06:04:13.195343 run osmo-hlr_10.42.42.2(pid=15490): stdout: | (launched: 2022-12-14_06:04:09.772144) 06:04:13.246347 run osmo-hlr_10.42.42.2(pid=15490): stderr: | 20221214060409967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060409967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060409967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060409967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060409967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060409967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060409980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060409988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060409988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060409988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:13.298026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15489): Terminating (SIGTERM) 06:04:13.339373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15492): Terminating (SIGTERM) 06:04:13.380717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15495): Terminating (SIGTERM) 06:04:13.422306 --- ParallelTerminationStrategy: PID 15489 died... 06:04:13.442149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15489): Terminated: ok {rc=0} 06:04:13.487904 --- ParallelTerminationStrategy: PID 15492 died... 06:04:13.507308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15492): Terminated: ok {rc=0} 06:04:13.553092 --- ParallelTerminationStrategy: PID 15495 died... 06:04:13.572420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15495): Terminated: ok {rc=0} 06:04:13.660938 bus /gobi_0: Setting Powered False 06:04:14.758925 bus /gobi_0: Setting Powered False 06:04:15.876109 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:04:17.191914 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:17.201965 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:04:17.242121 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:04:17.281470 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:04:17.334429 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:04:17.368474 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:04:17.402982 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:04:17.963435 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:04:17.968726 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:17.980342 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:04:18.051859 tst switch_tch_pdch.py: using LAC 38911 06:04:18.180504 tst switch_tch_pdch.py: using RAC 151 06:04:18.308271 tst switch_tch_pdch.py: using CellId 38911 06:04:18.435221 tst switch_tch_pdch.py: using BVCI 38912 06:04:18.553642 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.565258 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.576482 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.587823 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.599139 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.610497 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.621938 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:04:18.633191 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:04:18.749069 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:04:18.869819 tst switch_tch_pdch.py:51: start network... 06:04:19.075054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:19.520612 run create_hlr_db(pid=15500): Launched 06:04:19.638585 bus /gobi_6: Setting Powered False 06:04:20.699381 run create_hlr_db(pid=15500): Terminated: ok {rc=0} 06:04:21.098001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Launched 06:04:21.401646 run osmo-hlr_10.42.42.2(pid=15503): Launched 06:04:21.518073 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:22.017343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Launched 06:04:22.319020 run osmo-stp_10.42.42.5(pid=15506): Launched 06:04:22.434578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:04:22.931106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15508): Launched 06:04:23.046792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:04:23.303245 run patchelf(pid=15509): Launched 06:04:23.471733 run osmo-stp_10.42.42.5(pid=15506): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] 06:04:23.600310 run osmo-stp_10.42.42.5(pid=15506): stdout: | (launched: 2022-12-14_06:04:22.263792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:23.730753 run osmo-stp_10.42.42.5(pid=15506): stderr: | 20221214060422430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060422430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060422430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060422431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060422431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060422431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060422431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:23.861090 run osmo-stp_10.42.42.5(pid=15506): stdout: | (launched: 2022-12-14_06:04:22.263792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:23.985457 run osmo-stp_10.42.42.5(pid=15506): stderr: | 20221214060422430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060422430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060422430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060422431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060422431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060422431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060422431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:24.132874 run patchelf(pid=15509): Terminating (SIGINT) 06:04:24.303283 run patchelf(pid=15509): Terminated: ok {rc=0} 06:04:24.425712 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15506): Process ended prematurely: osmo-stp_10.42.42.5(pid=15506) [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:04:24.434571 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 06:04:24.460765 run osmo-hlr_10.42.42.2(pid=15503): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15503)] 06:04:24.508607 run osmo-hlr_10.42.42.2(pid=15503): stdout: | (launched: 2022-12-14_06:04:21.346248) 06:04:24.558055 run osmo-hlr_10.42.42.2(pid=15503): stderr: | 20221214060421520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060421520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060421520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060421520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060421520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060421520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060421530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060421538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060421539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060421539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:24.607857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Terminating (SIGTERM) 06:04:24.647882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Terminating (SIGTERM) 06:04:24.687808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15508): Terminating (SIGTERM) 06:04:24.728007 --- ParallelTerminationStrategy: PID 15502 died... 06:04:24.747364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Terminated: ok {rc=0} 06:04:24.791658 --- ParallelTerminationStrategy: PID 15505 died... 06:04:24.810421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Terminated: ok {rc=0} 06:04:24.854300 --- ParallelTerminationStrategy: PID 15508 died... 06:04:24.873345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15508): Terminated: ok {rc=0} 06:04:24.956579 bus /gobi_0: Setting Powered False 06:04:26.050784 bus /gobi_0: Setting Powered False 06:04:27.166457 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:trx-umtrx --------------------------------------------------------------------- 06:04:28.418807 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:28.423856 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:04:28.456754 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 06:04:28.464018 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 06:04:28.515461 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:04:28.548322 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 06:04:28.555234 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 06:04:29.094701 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 06:04:29.099802 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 06:04:29.110857 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 06:04:29.158209 tst mo_mt_sms.py: using LAC 38912 06:04:29.288553 tst mo_mt_sms.py: using RAC 152 06:04:29.415423 tst mo_mt_sms.py: using CellId 38912 06:04:29.540782 tst mo_mt_sms.py: using BVCI 38913 06:04:29.658114 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:04:29.772015 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:04:29.887511 tst mo_mt_sms.py:9: start nitb and bts... 06:04:30.093475 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:04:30.711496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15513): Launched 06:04:31.038417 run osmo-nitb_10.42.42.2(pid=15514): Launched 06:04:31.225369 run osmo-nitb_10.42.42.2(pid=15514): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15514)] 06:04:31.366206 run osmo-nitb_10.42.42.2(pid=15514): stdout: | (launched: 2022-12-14_06:04:30.976789) 06:04:31.507976 run osmo-nitb_10.42.42.2(pid=15514): stderr: | (launched: 2022-12-14_06:04:31.022933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:04:31.649819 run osmo-nitb_10.42.42.2(pid=15514): stdout: | (launched: 2022-12-14_06:04:30.976789) 06:04:31.785801 run osmo-nitb_10.42.42.2(pid=15514): stderr: | (launched: 2022-12-14_06:04:31.022933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15514) [trial-2400↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15514)] 06:04:32.170535 tst osmo-nitb_10.42.42.2(pid=15514): stdout: | (launched: 2022-12-14_06:04:30.976789) 06:04:32.300549 tst osmo-nitb_10.42.42.2(pid=15514): stderr: | (launched: 2022-12-14_06:04:31.022933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:04:32.445472 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15514) [trial-2400↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15514)] [trial-2400↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 06:04:32.454163 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 06:04:32.460839 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15513): Terminating (SIGTERM) 06:04:32.670805 --- ParallelTerminationStrategy: PID 15513 died... 06:04:32.691524 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15513): Terminated: ok {rc=0} 06:04:32.776780 bus /sierra_3: Setting Powered False 06:04:33.876181 bus /sierra_3: Setting Powered False 06:04:34.993535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:trx-umtrx --------------------------------------------------------------------- 06:04:36.186483 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:36.190578 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:04:36.222435 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:04:36.249839 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 06:04:36.300368 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:04:36.332016 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:04:36.358263 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 06:04:36.905554 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 06:04:36.910612 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:36.921300 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 06:04:36.968774 tst mo_mt_sms.py: using LAC 38913 06:04:37.089822 tst mo_mt_sms.py: using RAC 153 06:04:37.212313 tst mo_mt_sms.py: using CellId 38913 06:04:37.331273 tst mo_mt_sms.py: using BVCI 38914 06:04:37.441644 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:37.452238 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:37.462622 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:37.472795 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:37.483137 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:37.493590 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:04:37.613849 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:04:37.728897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:38.198323 run create_hlr_db(pid=15518): Launched 06:04:38.313480 bus /sierra_2: Setting Powered False 06:04:39.373710 run create_hlr_db(pid=15518): Terminated: ok {rc=0} 06:04:39.803234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15520): Launched 06:04:40.105320 run osmo-hlr_10.42.42.2(pid=15521): Launched 06:04:40.220520 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:40.753122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15523): Launched 06:04:41.055704 run osmo-stp_10.42.42.5(pid=15524): Launched 06:04:41.171297 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:41.733744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15526): Launched 06:04:42.057720 run osmo-msc_10.42.42.6(pid=15527): Launched 06:04:42.238135 run osmo-stp_10.42.42.5(pid=15524): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15524)] 06:04:42.374169 run osmo-stp_10.42.42.5(pid=15524): stdout: | (launched: 2022-12-14_06:04:41.000404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:42.510599 run osmo-stp_10.42.42.5(pid=15524): stderr: | 20221214060441169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060441169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060441170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060441170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060441170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060441171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060441171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:42.645447 run osmo-stp_10.42.42.5(pid=15524): stdout: | (launched: 2022-12-14_06:04:41.000404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:42.774120 run osmo-stp_10.42.42.5(pid=15524): stderr: | 20221214060441169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060441169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060441170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060441170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060441170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060441171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060441171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:42.928283 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15524): Process ended prematurely: osmo-stp_10.42.42.5(pid=15524) [trial-2400↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15524)] [trial-2400↪sms:trx-umtrx↪mo_mt_sms.py:16] 06:04:42.937362 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 06:04:42.964375 run osmo-hlr_10.42.42.2(pid=15521): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15521)] 06:04:43.014254 run osmo-hlr_10.42.42.2(pid=15521): stdout: | (launched: 2022-12-14_06:04:40.050256) 06:04:43.065825 run osmo-hlr_10.42.42.2(pid=15521): stderr: | 20221214060440221 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060440221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060440221 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060440221 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060440221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060440221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060440233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060440241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060440241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060440241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:43.137884 run osmo-msc_10.42.42.6(pid=15527): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15527)] 06:04:43.187792 run osmo-msc_10.42.42.6(pid=15527): stdout: | (launched: 2022-12-14_06:04:41.999592) 06:04:43.239206 run osmo-msc_10.42.42.6(pid=15527): stderr: | 20221214060442315 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060442316 DLGLOBAL DEBUG validating counter group 0x7f9094506c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060442316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060442316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060442316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060442316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060442318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060442318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060442318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060442318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:43.291055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15520): Terminating (SIGTERM) 06:04:43.332343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15523): Terminating (SIGTERM) 06:04:43.374210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15526): Terminating (SIGTERM) 06:04:43.415748 --- ParallelTerminationStrategy: PID 15520 died... 06:04:43.435667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15520): Terminated: ok {rc=0} 06:04:43.481561 --- ParallelTerminationStrategy: PID 15523 died... 06:04:43.500916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15523): Terminated: ok {rc=0} 06:04:43.546767 --- ParallelTerminationStrategy: PID 15526 died... 06:04:43.566237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15526): Terminated: ok {rc=0} 06:04:43.652297 bus /sierra_3: Setting Powered False 06:04:44.749290 bus /sierra_3: Setting Powered False 06:04:45.877756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 06:04:47.152428 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:47.157549 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:04:47.200890 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 06:04:47.208502 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 06:04:47.251938 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:04:47.295135 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 06:04:47.302419 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 06:04:47.806665 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 06:04:47.811828 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 06:04:47.822669 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 06:04:47.869103 tst assert_extension.py: using LAC 38914 06:04:47.990599 tst assert_extension.py: using RAC 154 06:04:48.109411 tst assert_extension.py: using CellId 38914 06:04:48.225750 tst assert_extension.py: using BVCI 38915 06:04:48.336233 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 06:04:48.454947 tst assert_extension.py:10: start nitb and bts... 06:04:48.673784 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:04:49.333073 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15532): Launched 06:04:49.655656 run osmo-nitb_10.42.42.2(pid=15533): Launched 06:04:49.834381 run osmo-nitb_10.42.42.2(pid=15533): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15533)] 06:04:49.978904 run osmo-nitb_10.42.42.2(pid=15533): stdout: | (launched: 2022-12-14_06:04:49.597432) 06:04:50.125382 run osmo-nitb_10.42.42.2(pid=15533): stderr: | (launched: 2022-12-14_06:04:49.645400) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:04:50.271749 run osmo-nitb_10.42.42.2(pid=15533): stdout: | (launched: 2022-12-14_06:04:49.597432) 06:04:50.412205 run osmo-nitb_10.42.42.2(pid=15533): stderr: | (launched: 2022-12-14_06:04:49.645400) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15533) [trial-2400↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15533)] 06:04:50.777483 tst osmo-nitb_10.42.42.2(pid=15533): stdout: | (launched: 2022-12-14_06:04:49.597432) 06:04:50.908635 tst osmo-nitb_10.42.42.2(pid=15533): stderr: | (launched: 2022-12-14_06:04:49.645400) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:04:51.063512 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15533) [trial-2400↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15533)] [trial-2400↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 06:04:51.072389 tst assert_extension.py:12: Test FAILED (3.3 sec) 06:04:51.079422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15532): Terminating (SIGTERM) 06:04:51.290692 --- ParallelTerminationStrategy: PID 15532 died... 06:04:51.312237 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15532): Terminated: ok {rc=0} 06:04:51.400889 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:trx-umtrx --------------------------------------------------------------------- 06:04:52.572417 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:52.576786 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:04:52.609122 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:04:52.636425 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 06:04:52.672313 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:04:52.707522 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:04:52.735257 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 06:04:53.257652 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 06:04:53.263547 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:53.274679 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 06:04:53.320877 tst assert_extension.py: using LAC 38915 06:04:53.439598 tst assert_extension.py: using RAC 155 06:04:53.564294 tst assert_extension.py: using CellId 38915 06:04:53.682624 tst assert_extension.py: using BVCI 38916 06:04:53.794075 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:53.804663 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:53.815082 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:53.825357 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:53.836052 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:53.846565 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 06:04:53.961381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:54.430168 run create_hlr_db(pid=15538): Launched 06:04:54.545503 bus /sierra_2: Setting Powered False 06:04:55.605966 run create_hlr_db(pid=15538): Terminated: ok {rc=0} 06:04:56.048158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15540): Launched 06:04:56.371455 run osmo-hlr_10.42.42.2(pid=15541): Launched 06:04:56.495699 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:57.062859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15543): Launched 06:04:57.385391 run osmo-stp_10.42.42.5(pid=15544): Launched 06:04:57.510689 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:58.094765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15546): Launched 06:04:58.416349 run osmo-msc_10.42.42.6(pid=15547): Launched 06:04:58.597110 run osmo-stp_10.42.42.5(pid=15544): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15544)] 06:04:58.732747 run osmo-stp_10.42.42.5(pid=15544): stdout: | (launched: 2022-12-14_06:04:57.326968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:58.868626 run osmo-stp_10.42.42.5(pid=15544): stderr: | 20221214060457516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060457516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060457516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060457517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060457517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060457517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060457517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:59.003385 run osmo-stp_10.42.42.5(pid=15544): stdout: | (launched: 2022-12-14_06:04:57.326968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:59.131534 run osmo-stp_10.42.42.5(pid=15544): stderr: | 20221214060457516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060457516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060457516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060457517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060457517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060457517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060457517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:59.284777 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15544): Process ended prematurely: osmo-stp_10.42.42.5(pid=15544) [trial-2400↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15544)] [trial-2400↪ussd:trx-umtrx↪assert_extension.py:17] 06:04:59.293635 tst assert_extension.py:17: Test FAILED (6.0 sec) 06:04:59.320622 run osmo-hlr_10.42.42.2(pid=15541): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15541)] 06:04:59.370196 run osmo-hlr_10.42.42.2(pid=15541): stdout: | (launched: 2022-12-14_06:04:56.312653) 06:04:59.421294 run osmo-hlr_10.42.42.2(pid=15541): stderr: | 20221214060456510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060456510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060456510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060456510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060456510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060456510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060456523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060456531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060456532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060456532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:59.493476 run osmo-msc_10.42.42.6(pid=15547): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15547)] 06:04:59.542967 run osmo-msc_10.42.42.6(pid=15547): stdout: | (launched: 2022-12-14_06:04:58.357825) 06:04:59.594174 run osmo-msc_10.42.42.6(pid=15547): stderr: | 20221214060458679 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060458679 DLGLOBAL DEBUG validating counter group 0x7fec06364c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060458679 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060458679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060458679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060458680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060458681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060458682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060458682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060458682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:59.645701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15540): Terminating (SIGTERM) 06:04:59.686942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15543): Terminating (SIGTERM) 06:04:59.728314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15546): Terminating (SIGTERM) 06:04:59.770019 --- ParallelTerminationStrategy: PID 15540 died... 06:04:59.789814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15540): Terminated: ok {rc=0} 06:04:59.835568 --- ParallelTerminationStrategy: PID 15543 died... 06:04:59.854806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15543): Terminated: ok {rc=0} 06:04:59.900292 --- ParallelTerminationStrategy: PID 15546 died... 06:04:59.919593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15546): Terminated: ok {rc=0} 06:05:00.006448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:05:01.246230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:01.256454 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:05:01.298745 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:05:01.332344 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:05:01.386832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:05:01.436571 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:05:01.465106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:05:02.015280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:05:02.070907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:02.083045 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:05:02.167220 tst mo_mt_call.py: using LAC 38916 06:05:02.323641 tst mo_mt_call.py: using RAC 156 06:05:02.455991 tst mo_mt_call.py: using CellId 38916 06:05:02.585071 tst mo_mt_call.py: using BVCI 38917 06:05:02.704606 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:02.716434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:02.727977 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:02.739573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:02.751363 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:02.763037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:05:02.881560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:05:03.001344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:03.510381 run create_hlr_db(pid=15555): Launched 06:05:03.644364 bus /sierra_2: Setting Powered False 06:05:04.709224 run create_hlr_db(pid=15555): Terminated: ok {rc=0} 06:05:05.167220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15557): Launched 06:05:05.496244 run osmo-hlr_10.42.42.2(pid=15558): Launched 06:05:05.621883 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:06.187526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15560): Launched 06:05:06.517380 run osmo-stp_10.42.42.5(pid=15561): Launched 06:05:06.642263 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:07.238005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15563): Launched 06:05:07.567981 run osmo-msc_10.42.42.6(pid=15564): Launched 06:05:07.751228 run osmo-stp_10.42.42.5(pid=15561): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15561)] 06:05:07.890002 run osmo-stp_10.42.42.5(pid=15561): stdout: | (launched: 2022-12-14_06:05:06.457887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:08.028849 run osmo-stp_10.42.42.5(pid=15561): stderr: | 20221214060506650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060506650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060506650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060506651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060506651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060506651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060506651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:08.166750 run osmo-stp_10.42.42.5(pid=15561): stdout: | (launched: 2022-12-14_06:05:06.457887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:08.297816 run osmo-stp_10.42.42.5(pid=15561): stderr: | 20221214060506650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060506650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060506650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060506651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060506651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060506651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060506651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:08.454978 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15561): Process ended prematurely: osmo-stp_10.42.42.5(pid=15561) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15561)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:05:08.464731 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:05:08.492403 run osmo-hlr_10.42.42.2(pid=15558): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15558)] 06:05:08.542755 run osmo-hlr_10.42.42.2(pid=15558): stdout: | (launched: 2022-12-14_06:05:05.436761) 06:05:08.594911 run osmo-hlr_10.42.42.2(pid=15558): stderr: | 20221214060505634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060505634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060505634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060505634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060505634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060505634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060505648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060505658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060505658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060505658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:08.667412 run osmo-msc_10.42.42.6(pid=15564): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15564)] 06:05:08.717342 run osmo-msc_10.42.42.6(pid=15564): stdout: | (launched: 2022-12-14_06:05:07.507697) 06:05:08.769168 run osmo-msc_10.42.42.6(pid=15564): stderr: | 20221214060507829 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060507830 DLGLOBAL DEBUG validating counter group 0x7f352971ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060507830 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060507830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060507830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060507830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060507832 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060507832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060507832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060507832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:08.821267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15557): Terminating (SIGTERM) 06:05:08.863077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15560): Terminating (SIGTERM) 06:05:08.905463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15563): Terminating (SIGTERM) 06:05:08.948346 --- ParallelTerminationStrategy: PID 15557 died... 06:05:08.968654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15557): Terminated: ok {rc=0} 06:05:09.015221 --- ParallelTerminationStrategy: PID 15560 died... 06:05:09.035159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15560): Terminated: ok {rc=0} 06:05:09.081425 --- ParallelTerminationStrategy: PID 15563 died... 06:05:09.101383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15563): Terminated: ok {rc=0} 06:05:09.189421 bus /sierra_3: Setting Powered False 06:05:10.288356 bus /sierra_3: Setting Powered False 06:05:11.403580 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:05:12.547198 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:12.559187 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:05:12.628518 tst mo_mt_call_osmux.py: using LAC 38917 06:05:12.749076 tst mo_mt_call_osmux.py: using RAC 157 06:05:12.869762 tst mo_mt_call_osmux.py: using CellId 38917 06:05:12.992233 tst mo_mt_call_osmux.py: using BVCI 38918 06:05:13.105305 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:13.116291 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:13.127166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:13.138153 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:13.149465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:05:13.160662 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:05:13.277239 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:05:13.397993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:13.909714 run create_hlr_db(pid=15566): Launched 06:05:14.042564 bus /sierra_2: Setting Powered False 06:05:15.106878 run create_hlr_db(pid=15566): Terminated: ok {rc=0} 06:05:15.546100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15568): Launched 06:05:15.865749 run osmo-hlr_10.42.42.2(pid=15569): Launched 06:05:16.092648 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:16.788223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15571): Launched 06:05:17.142972 run osmo-stp_10.42.42.5(pid=15572): Launched 06:05:17.338149 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:17.897548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15574): Launched 06:05:18.205740 run osmo-msc_10.42.42.6(pid=15575): Launched 06:05:18.377623 run osmo-stp_10.42.42.5(pid=15572): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15572)] 06:05:18.507619 run osmo-stp_10.42.42.5(pid=15572): stdout: | (launched: 2022-12-14_06:05:17.077928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:18.637731 run osmo-stp_10.42.42.5(pid=15572): stderr: | 20221214060517329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060517329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060517329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060517330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060517330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060517330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060517330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:18.765926 run osmo-stp_10.42.42.5(pid=15572): stdout: | (launched: 2022-12-14_06:05:17.077928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:18.888376 run osmo-stp_10.42.42.5(pid=15572): stderr: | 20221214060517329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060517329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060517329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060517330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060517330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060517330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060517330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:19.034900 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15572): Process ended prematurely: osmo-stp_10.42.42.5(pid=15572) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15572)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:05:19.043752 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:05:19.070036 run osmo-hlr_10.42.42.2(pid=15569): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15569)] 06:05:19.118132 run osmo-hlr_10.42.42.2(pid=15569): stdout: | (launched: 2022-12-14_06:05:15.798733) 06:05:19.167088 run osmo-hlr_10.42.42.2(pid=15569): stderr: | 20221214060516070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060516071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060516071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060516071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060516071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060516071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060516092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060516113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060516113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060516113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:19.236087 run osmo-msc_10.42.42.6(pid=15575): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15575)] 06:05:19.283301 run osmo-msc_10.42.42.6(pid=15575): stdout: | (launched: 2022-12-14_06:05:18.149682) 06:05:19.332752 run osmo-msc_10.42.42.6(pid=15575): stderr: | 20221214060518420 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060518420 DLGLOBAL DEBUG validating counter group 0x7effca280c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060518420 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060518420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060518420 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060518420 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060518422 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060518423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060518423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060518423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:19.382202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15568): Terminating (SIGTERM) 06:05:19.421779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15571): Terminating (SIGTERM) 06:05:19.461251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15574): Terminating (SIGTERM) 06:05:19.501741 --- ParallelTerminationStrategy: PID 15568 died... 06:05:19.520859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15568): Terminated: ok {rc=0} 06:05:19.564766 --- ParallelTerminationStrategy: PID 15571 died... 06:05:19.583570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15571): Terminated: ok {rc=0} 06:05:19.627471 --- ParallelTerminationStrategy: PID 15574 died... 06:05:19.646287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15574): Terminated: ok {rc=0} 06:05:19.731618 bus /sierra_3: Setting Powered False 06:05:20.829870 bus /sierra_3: Setting Powered False 06:05:21.944282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:05:23.198122 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:23.204570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:05:23.236436 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:05:23.263503 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:05:23.312710 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:05:23.344616 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:05:23.371251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:05:23.923441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:05:23.973570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:23.984650 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:05:24.050955 tst mo_mt_call.py: using LAC 38918 06:05:24.170099 tst mo_mt_call.py: using RAC 158 06:05:24.290941 tst mo_mt_call.py: using CellId 38918 06:05:24.414566 tst mo_mt_call.py: using BVCI 38919 06:05:24.527623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:24.538913 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:24.550032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:24.560855 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:24.572384 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:24.583945 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:05:24.705081 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:05:24.822584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:25.300391 run create_hlr_db(pid=15580): Launched 06:05:25.417645 bus /sierra_2: Setting Powered False 06:05:26.478608 run create_hlr_db(pid=15580): Terminated: ok {rc=0} 06:05:26.927412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15582): Launched 06:05:27.257144 run osmo-hlr_10.42.42.2(pid=15583): Launched 06:05:27.382542 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:27.956412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15585): Launched 06:05:28.285382 run osmo-stp_10.42.42.5(pid=15586): Launched 06:05:28.409869 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:29.004128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15588): Launched 06:05:29.332831 run osmo-msc_10.42.42.6(pid=15589): Launched 06:05:29.516052 run osmo-stp_10.42.42.5(pid=15586): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15586)] 06:05:29.654522 run osmo-stp_10.42.42.5(pid=15586): stdout: | (launched: 2022-12-14_06:05:28.225794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:29.793710 run osmo-stp_10.42.42.5(pid=15586): stderr: | 20221214060528415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060528415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060528416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060528416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060528417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060528417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060528417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:29.931079 run osmo-stp_10.42.42.5(pid=15586): stdout: | (launched: 2022-12-14_06:05:28.225794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:30.062099 run osmo-stp_10.42.42.5(pid=15586): stderr: | 20221214060528415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060528415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060528416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060528416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060528417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060528417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060528417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:30.219030 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15586): Process ended prematurely: osmo-stp_10.42.42.5(pid=15586) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15586)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:05:30.228451 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:05:30.256247 run osmo-hlr_10.42.42.2(pid=15583): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15583)] 06:05:30.306202 run osmo-hlr_10.42.42.2(pid=15583): stdout: | (launched: 2022-12-14_06:05:27.197452) 06:05:30.358086 run osmo-hlr_10.42.42.2(pid=15583): stderr: | 20221214060527392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060527392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060527392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060527393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060527393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060527393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060527403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060527412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060527412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060527412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:30.430255 run osmo-msc_10.42.42.6(pid=15589): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15589)] 06:05:30.480200 run osmo-msc_10.42.42.6(pid=15589): stdout: | (launched: 2022-12-14_06:05:29.273282) 06:05:30.531845 run osmo-msc_10.42.42.6(pid=15589): stderr: | 20221214060529593 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060529593 DLGLOBAL DEBUG validating counter group 0x7f6518720c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060529594 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060529594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060529594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060529594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060529596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060529596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060529596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060529596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:30.583381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15582): Terminating (SIGTERM) 06:05:30.624556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15585): Terminating (SIGTERM) 06:05:30.665884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15588): Terminating (SIGTERM) 06:05:30.707406 --- ParallelTerminationStrategy: PID 15582 died... 06:05:30.727451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15582): Terminated: ok {rc=0} 06:05:30.773386 --- ParallelTerminationStrategy: PID 15585 died... 06:05:30.792735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15585): Terminated: ok {rc=0} 06:05:30.838823 --- ParallelTerminationStrategy: PID 15588 died... 06:05:30.859565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15588): Terminated: ok {rc=0} 06:05:30.956492 bus /sierra_3: Setting Powered False 06:05:32.057463 bus /sierra_3: Setting Powered False 06:05:33.174761 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:05:34.324578 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:34.337215 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:05:34.408014 tst mo_mt_call_osmux.py: using LAC 38919 06:05:34.536938 tst mo_mt_call_osmux.py: using RAC 159 06:05:34.665800 tst mo_mt_call_osmux.py: using CellId 38919 06:05:34.788111 tst mo_mt_call_osmux.py: using BVCI 38920 06:05:34.902064 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:34.913423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:34.924406 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:34.935490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:34.946813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:05:34.957996 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:05:35.079411 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:05:35.200166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:35.678472 run create_hlr_db(pid=15591): Launched 06:05:35.796105 bus /sierra_2: Setting Powered False 06:05:36.857410 run create_hlr_db(pid=15591): Terminated: ok {rc=0} 06:05:37.308443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15593): Launched 06:05:37.637775 run osmo-hlr_10.42.42.2(pid=15594): Launched 06:05:37.764456 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:38.331841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15596): Launched 06:05:38.659261 run osmo-stp_10.42.42.5(pid=15597): Launched 06:05:38.784728 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:39.377591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15599): Launched 06:05:39.705721 run osmo-msc_10.42.42.6(pid=15600): Launched 06:05:39.887814 run osmo-stp_10.42.42.5(pid=15597): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15597)] 06:05:40.027312 run osmo-stp_10.42.42.5(pid=15597): stdout: | (launched: 2022-12-14_06:05:38.600024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:40.165232 run osmo-stp_10.42.42.5(pid=15597): stderr: | 20221214060538787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060538788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060538788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060538788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060538789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060538789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060538789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:40.301832 run osmo-stp_10.42.42.5(pid=15597): stdout: | (launched: 2022-12-14_06:05:38.600024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:40.432299 run osmo-stp_10.42.42.5(pid=15597): stderr: | 20221214060538787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060538788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060538788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060538788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060538789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060538789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060538789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:40.588613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15597): Process ended prematurely: osmo-stp_10.42.42.5(pid=15597) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15597)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:05:40.598091 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:05:40.625312 run osmo-hlr_10.42.42.2(pid=15594): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15594)] 06:05:40.674557 run osmo-hlr_10.42.42.2(pid=15594): stdout: | (launched: 2022-12-14_06:05:37.578750) 06:05:40.725666 run osmo-hlr_10.42.42.2(pid=15594): stderr: | 20221214060537774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060537774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060537774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060537774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060537774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060537774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060537786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060537797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060537797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060537797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:40.796558 run osmo-msc_10.42.42.6(pid=15600): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15600)] 06:05:40.845684 run osmo-msc_10.42.42.6(pid=15600): stdout: | (launched: 2022-12-14_06:05:39.646049) 06:05:40.896787 run osmo-msc_10.42.42.6(pid=15600): stderr: | 20221214060539965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060539965 DLGLOBAL DEBUG validating counter group 0x7f6f171edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060539965 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060539965 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060539965 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060539966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060539967 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060539968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060539968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060539968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:40.947950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15593): Terminating (SIGTERM) 06:05:40.989041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15596): Terminating (SIGTERM) 06:05:41.030101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15599): Terminating (SIGTERM) 06:05:41.071308 --- ParallelTerminationStrategy: PID 15593 died... 06:05:41.090981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15593): Terminated: ok {rc=0} 06:05:41.136357 --- ParallelTerminationStrategy: PID 15596 died... 06:05:41.155649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15596): Terminated: ok {rc=0} 06:05:41.200697 --- ParallelTerminationStrategy: PID 15599 died... 06:05:41.219924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15599): Terminated: ok {rc=0} 06:05:41.306833 bus /sierra_3: Setting Powered False 06:05:42.401259 bus /sierra_3: Setting Powered False 06:05:43.515729 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:05:44.762996 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:44.769389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:05:44.801141 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:05:44.828193 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:05:44.878987 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:05:44.911328 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:05:44.938476 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:05:45.488464 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:05:45.539838 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:45.551001 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:05:45.619288 tst mo_mt_call.py: using LAC 38920 06:05:45.741600 tst mo_mt_call.py: using RAC 160 06:05:45.887415 tst mo_mt_call.py: using CellId 38920 06:05:46.033364 tst mo_mt_call.py: using BVCI 38921 06:05:46.157399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:46.170078 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:46.182504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:46.194950 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:46.207972 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:46.220243 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:46.344797 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:46.473919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:47.006713 run create_hlr_db(pid=15605): Launched 06:05:47.158686 bus /sierra_2: Setting Powered False 06:05:48.219526 run create_hlr_db(pid=15605): Terminated: ok {rc=0} 06:05:48.669851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15607): Launched 06:05:49.000328 run osmo-hlr_10.42.42.2(pid=15608): Launched 06:05:49.125577 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:49.692812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15610): Launched 06:05:50.023979 run osmo-stp_10.42.42.5(pid=15611): Launched 06:05:50.148386 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:50.743412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15613): Launched 06:05:51.073113 run osmo-msc_10.42.42.6(pid=15614): Launched 06:05:51.256163 run osmo-stp_10.42.42.5(pid=15611): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15611)] 06:05:51.394399 run osmo-stp_10.42.42.5(pid=15611): stdout: | (launched: 2022-12-14_06:05:49.964091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:51.533221 run osmo-stp_10.42.42.5(pid=15611): stderr: | 20221214060550155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060550156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060550156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060550156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060550157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060550157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060550157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:51.670995 run osmo-stp_10.42.42.5(pid=15611): stdout: | (launched: 2022-12-14_06:05:49.964091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:51.801849 run osmo-stp_10.42.42.5(pid=15611): stderr: | 20221214060550155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060550156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060550156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060550156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060550157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060550157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060550157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:51.961974 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15611): Process ended prematurely: osmo-stp_10.42.42.5(pid=15611) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15611)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:05:51.970857 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:05:51.997195 run osmo-hlr_10.42.42.2(pid=15608): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15608)] 06:05:52.045268 run osmo-hlr_10.42.42.2(pid=15608): stdout: | (launched: 2022-12-14_06:05:48.940551) 06:05:52.096454 run osmo-hlr_10.42.42.2(pid=15608): stderr: | 20221214060549137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060549137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060549137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060549137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060549137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060549137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060549176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060549185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060549185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060549185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:52.165360 run osmo-msc_10.42.42.6(pid=15614): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15614)] 06:05:52.212198 run osmo-msc_10.42.42.6(pid=15614): stdout: | (launched: 2022-12-14_06:05:51.013500) 06:05:52.261269 run osmo-msc_10.42.42.6(pid=15614): stderr: | 20221214060551331 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060551332 DLGLOBAL DEBUG validating counter group 0x7f9b53b6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060551332 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060551332 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060551332 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060551332 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060551334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060551334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060551334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060551335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:52.310648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15607): Terminating (SIGTERM) 06:05:52.349966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15610): Terminating (SIGTERM) 06:05:52.389292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15613): Terminating (SIGTERM) 06:05:52.428715 --- ParallelTerminationStrategy: PID 15607 died... 06:05:52.447980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15607): Terminated: ok {rc=0} 06:05:52.491502 --- ParallelTerminationStrategy: PID 15610 died... 06:05:52.510204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15610): Terminated: ok {rc=0} 06:05:52.553564 --- ParallelTerminationStrategy: PID 15613 died... 06:05:52.572204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15613): Terminated: ok {rc=0} 06:05:52.655747 bus /sierra_3: Setting Powered False 06:05:53.751964 bus /sierra_3: Setting Powered False 06:05:54.870849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:05:56.017095 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:56.028939 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:05:56.098466 tst mo_mt_call_osmux.py: using LAC 38921 06:05:56.219498 tst mo_mt_call_osmux.py: using RAC 161 06:05:56.341819 tst mo_mt_call_osmux.py: using CellId 38921 06:05:56.464625 tst mo_mt_call_osmux.py: using BVCI 38922 06:05:56.577727 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:56.588683 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:56.599561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:56.610431 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:56.621823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:56.633010 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:56.751300 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:56.868235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:57.347725 run create_hlr_db(pid=15620): Launched 06:05:57.465480 bus /sierra_2: Setting Powered False 06:05:58.527165 run create_hlr_db(pid=15620): Terminated: ok {rc=0} 06:05:58.978171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Launched 06:05:59.308651 run osmo-hlr_10.42.42.2(pid=15623): Launched 06:05:59.434326 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:00.003445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Launched 06:06:00.332766 run osmo-stp_10.42.42.5(pid=15626): Launched 06:06:00.458745 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:01.067304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15628): Launched 06:06:01.392634 run osmo-msc_10.42.42.6(pid=15629): Launched 06:06:01.750852 run osmo-stp_10.42.42.5(pid=15626): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] 06:06:02.032508 run osmo-stp_10.42.42.5(pid=15626): stdout: | (launched: 2022-12-14_06:06:00.273139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:02.242452 run osmo-stp_10.42.42.5(pid=15626): stderr: | 20221214060600462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060600463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060600463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060600463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060600464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060600464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060600464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:02.382317 run osmo-stp_10.42.42.5(pid=15626): stdout: | (launched: 2022-12-14_06:06:00.273139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:02.512630 run osmo-stp_10.42.42.5(pid=15626): stderr: | 20221214060600462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060600463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060600463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060600463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060600464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060600464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060600464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:02.668786 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15626): Process ended prematurely: osmo-stp_10.42.42.5(pid=15626) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:06:02.678398 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 06:06:02.706382 run osmo-hlr_10.42.42.2(pid=15623): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15623)] 06:06:02.755841 run osmo-hlr_10.42.42.2(pid=15623): stdout: | (launched: 2022-12-14_06:05:59.249105) 06:06:02.807095 run osmo-hlr_10.42.42.2(pid=15623): stderr: | 20221214060559443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060559443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060559443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060559443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060559443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060559443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060559455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060559464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060559464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060559464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:02.878738 run osmo-msc_10.42.42.6(pid=15629): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15629)] 06:06:02.928704 run osmo-msc_10.42.42.6(pid=15629): stdout: | (launched: 2022-12-14_06:06:01.333797) 06:06:02.979997 run osmo-msc_10.42.42.6(pid=15629): stderr: | 20221214060601926 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060601926 DLGLOBAL DEBUG validating counter group 0x7f49dcc82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060601926 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060601926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060601927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060601927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060601928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060601929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060601929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060601929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:03.031608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Terminating (SIGTERM) 06:06:03.073280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Terminating (SIGTERM) 06:06:03.114795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15628): Terminating (SIGTERM) 06:06:03.156364 --- ParallelTerminationStrategy: PID 15622 died... 06:06:03.176164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Terminated: ok {rc=0} 06:06:03.222018 --- ParallelTerminationStrategy: PID 15625 died... 06:06:03.241466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Terminated: ok {rc=0} 06:06:03.287080 --- ParallelTerminationStrategy: PID 15628 died... 06:06:03.306588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15628): Terminated: ok {rc=0} 06:06:03.393661 bus /sierra_3: Setting Powered False 06:06:04.492708 bus /sierra_3: Setting Powered False 06:06:05.607589 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:06:06.864660 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:06.871720 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:06:06.904510 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:06:06.931987 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:06:06.982713 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:06:07.015984 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:06:07.043618 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:06:07.593167 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:06:07.644275 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:07.655575 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:06:07.722884 tst mo_mt_call.py: using LAC 38922 06:06:07.852544 tst mo_mt_call.py: using RAC 162 06:06:07.980412 tst mo_mt_call.py: using CellId 38922 06:06:08.108352 tst mo_mt_call.py: using BVCI 38923 06:06:08.228018 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:08.239698 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:08.251091 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:08.262379 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:08.273817 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:08.285133 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:06:08.401991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:06:08.525928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:09.038432 run create_hlr_db(pid=15634): Launched 06:06:09.171517 bus /sierra_2: Setting Powered False 06:06:10.232651 run create_hlr_db(pid=15634): Terminated: ok {rc=0} 06:06:10.692930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15636): Launched 06:06:11.023140 run osmo-hlr_10.42.42.2(pid=15637): Launched 06:06:11.147969 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:11.718708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15639): Launched 06:06:12.049548 run osmo-stp_10.42.42.5(pid=15640): Launched 06:06:12.175791 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:12.772919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15642): Launched 06:06:13.103279 run osmo-msc_10.42.42.6(pid=15643): Launched 06:06:13.285966 run osmo-stp_10.42.42.5(pid=15640): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15640)] 06:06:13.424831 run osmo-stp_10.42.42.5(pid=15640): stdout: | (launched: 2022-12-14_06:06:11.989612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:13.563814 run osmo-stp_10.42.42.5(pid=15640): stderr: | 20221214060612179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060612179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060612179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060612180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060612180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060612180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060612181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:13.701579 run osmo-stp_10.42.42.5(pid=15640): stdout: | (launched: 2022-12-14_06:06:11.989612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:13.833137 run osmo-stp_10.42.42.5(pid=15640): stderr: | 20221214060612179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060612179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060612179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060612180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060612180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060612180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060612181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:13.990347 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15640): Process ended prematurely: osmo-stp_10.42.42.5(pid=15640) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15640)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:06:13.999933 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:06:14.027791 run osmo-hlr_10.42.42.2(pid=15637): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15637)] 06:06:14.078602 run osmo-hlr_10.42.42.2(pid=15637): stdout: | (launched: 2022-12-14_06:06:10.963587) 06:06:14.130593 run osmo-hlr_10.42.42.2(pid=15637): stderr: | 20221214060611159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060611159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060611159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060611159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060611159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060611159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060611173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060611182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060611183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060611183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:14.203088 run osmo-msc_10.42.42.6(pid=15643): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15643)] 06:06:14.253388 run osmo-msc_10.42.42.6(pid=15643): stdout: | (launched: 2022-12-14_06:06:13.043701) 06:06:14.305451 run osmo-msc_10.42.42.6(pid=15643): stderr: | 20221214060613363 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060613363 DLGLOBAL DEBUG validating counter group 0x7efd984b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060613364 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060613364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060613364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060613364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060613366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060613366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060613366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060613366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:14.357805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15636): Terminating (SIGTERM) 06:06:14.399671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15639): Terminating (SIGTERM) 06:06:14.441913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15642): Terminating (SIGTERM) 06:06:14.484130 --- ParallelTerminationStrategy: PID 15636 died... 06:06:14.504116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15636): Terminated: ok {rc=0} 06:06:14.550428 --- ParallelTerminationStrategy: PID 15639 died... 06:06:14.570108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15639): Terminated: ok {rc=0} 06:06:14.616078 --- ParallelTerminationStrategy: PID 15642 died... 06:06:14.635668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15642): Terminated: ok {rc=0} 06:06:14.723301 bus /sierra_3: Setting Powered False 06:06:15.821330 bus /sierra_3: Setting Powered False 06:06:16.975421 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:06:18.136052 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:18.147766 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:06:18.216547 tst mo_mt_call_osmux.py: using LAC 38923 06:06:18.337342 tst mo_mt_call_osmux.py: using RAC 163 06:06:18.457405 tst mo_mt_call_osmux.py: using CellId 38923 06:06:18.590410 tst mo_mt_call_osmux.py: using BVCI 38924 06:06:18.703728 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:18.714790 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:18.725715 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:18.736453 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:18.747902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:06:18.758948 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:06:18.875525 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:06:18.996004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:19.507110 run create_hlr_db(pid=15645): Launched 06:06:19.641214 bus /sierra_2: Setting Powered False 06:06:20.705711 run create_hlr_db(pid=15645): Terminated: ok {rc=0} 06:06:21.163828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15647): Launched 06:06:21.492770 run osmo-hlr_10.42.42.2(pid=15648): Launched 06:06:21.618964 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:22.186080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15650): Launched 06:06:22.515602 run osmo-stp_10.42.42.5(pid=15651): Launched 06:06:22.641083 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:23.239071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15653): Launched 06:06:23.567417 run osmo-msc_10.42.42.6(pid=15654): Launched 06:06:23.752601 run osmo-stp_10.42.42.5(pid=15651): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15651)] 06:06:23.891010 run osmo-stp_10.42.42.5(pid=15651): stdout: | (launched: 2022-12-14_06:06:22.455890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:24.030916 run osmo-stp_10.42.42.5(pid=15651): stderr: | 20221214060622645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060622645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060622646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060622646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060622647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060622647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060622647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:24.168297 run osmo-stp_10.42.42.5(pid=15651): stdout: | (launched: 2022-12-14_06:06:22.455890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:24.298816 run osmo-stp_10.42.42.5(pid=15651): stderr: | 20221214060622645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060622645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060622646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060622646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060622647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060622647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060622647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:24.454820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15651): Process ended prematurely: osmo-stp_10.42.42.5(pid=15651) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15651)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:06:24.464256 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:06:24.491674 run osmo-hlr_10.42.42.2(pid=15648): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15648)] 06:06:24.540866 run osmo-hlr_10.42.42.2(pid=15648): stdout: | (launched: 2022-12-14_06:06:21.433328) 06:06:24.591968 run osmo-hlr_10.42.42.2(pid=15648): stderr: | 20221214060621628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060621628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060621628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060621628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060621628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060621628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060621641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060621651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060621651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060621651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:24.663207 run osmo-msc_10.42.42.6(pid=15654): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15654)] 06:06:24.712299 run osmo-msc_10.42.42.6(pid=15654): stdout: | (launched: 2022-12-14_06:06:23.507575) 06:06:24.763166 run osmo-msc_10.42.42.6(pid=15654): stderr: | 20221214060623825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060623825 DLGLOBAL DEBUG validating counter group 0x7f5709158c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060623825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060623825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060623825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060623826 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060623827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060623828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060623828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060623828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:24.814448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15647): Terminating (SIGTERM) 06:06:24.855494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15650): Terminating (SIGTERM) 06:06:24.896658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15653): Terminating (SIGTERM) 06:06:24.938536 --- ParallelTerminationStrategy: PID 15647 died... 06:06:24.958284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15647): Terminated: ok {rc=0} 06:06:25.003768 --- ParallelTerminationStrategy: PID 15650 died... 06:06:25.023063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15650): Terminated: ok {rc=0} 06:06:25.068310 --- ParallelTerminationStrategy: PID 15653 died... 06:06:25.087691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15653): Terminated: ok {rc=0} 06:06:25.174619 bus /sierra_3: Setting Powered False 06:06:26.271428 bus /sierra_3: Setting Powered False 06:06:27.385427 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:06:28.633117 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:28.640389 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:06:28.673804 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:06:28.701270 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:06:28.755044 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:06:28.788352 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:06:28.815402 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:06:29.367049 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:06:29.421227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:29.432844 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:06:29.504043 tst mo_mt_call.py: using LAC 38924 06:06:29.630255 tst mo_mt_call.py: using RAC 164 06:06:29.750804 tst mo_mt_call.py: using CellId 38924 06:06:29.871083 tst mo_mt_call.py: using BVCI 38925 06:06:29.985111 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:29.996228 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:30.007255 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:30.018122 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:30.029486 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:30.040632 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:06:30.161270 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:06:30.282685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:30.793391 run create_hlr_db(pid=15659): Launched 06:06:30.962536 bus /sierra_2: Setting Powered False 06:06:32.025985 run create_hlr_db(pid=15659): Terminated: ok {rc=0} 06:06:32.478417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15661): Launched 06:06:32.788571 run osmo-hlr_10.42.42.2(pid=15662): Launched 06:06:32.905910 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:33.436643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15664): Launched 06:06:33.745216 run osmo-stp_10.42.42.5(pid=15665): Launched 06:06:33.861652 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:34.430077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15667): Launched 06:06:34.737847 run osmo-msc_10.42.42.6(pid=15668): Launched 06:06:34.909528 run osmo-stp_10.42.42.5(pid=15665): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15665)] 06:06:35.039836 run osmo-stp_10.42.42.5(pid=15665): stdout: | (launched: 2022-12-14_06:06:33.689077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:35.169811 run osmo-stp_10.42.42.5(pid=15665): stderr: | 20221214060633861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060633861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060633861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060633861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060633862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060633862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060633862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:35.298146 run osmo-stp_10.42.42.5(pid=15665): stdout: | (launched: 2022-12-14_06:06:33.689077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:35.420557 run osmo-stp_10.42.42.5(pid=15665): stderr: | 20221214060633861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060633861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060633861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060633861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060633862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060633862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060633862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:35.566781 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15665): Process ended prematurely: osmo-stp_10.42.42.5(pid=15665) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15665)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:06:35.575970 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:06:35.602185 run osmo-hlr_10.42.42.2(pid=15662): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15662)] 06:06:35.649817 run osmo-hlr_10.42.42.2(pid=15662): stdout: | (launched: 2022-12-14_06:06:32.732133) 06:06:35.698705 run osmo-hlr_10.42.42.2(pid=15662): stderr: | 20221214060632905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060632905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060632905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060632905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060632905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060632906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060632922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060632933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060632933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060632933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:35.767101 run osmo-msc_10.42.42.6(pid=15668): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15668)] 06:06:35.814089 run osmo-msc_10.42.42.6(pid=15668): stdout: | (launched: 2022-12-14_06:06:34.681895) 06:06:35.863099 run osmo-msc_10.42.42.6(pid=15668): stderr: | 20221214060634949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060634950 DLGLOBAL DEBUG validating counter group 0x7f6e845f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060634950 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060634950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060634950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060634950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060634952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060634952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060634952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060634953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:35.912527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15661): Terminating (SIGTERM) 06:06:35.952317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15664): Terminating (SIGTERM) 06:06:35.991771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15667): Terminating (SIGTERM) 06:06:36.031288 --- ParallelTerminationStrategy: PID 15661 died... 06:06:36.050746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15661): Terminated: ok {rc=0} 06:06:36.094969 --- ParallelTerminationStrategy: PID 15664 died... 06:06:36.114014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15664): Terminated: ok {rc=0} 06:06:36.158153 --- ParallelTerminationStrategy: PID 15667 died... 06:06:36.177023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15667): Terminated: ok {rc=0} 06:06:36.262108 bus /sierra_3: Setting Powered False 06:06:37.360879 bus /sierra_3: Setting Powered False 06:06:38.476080 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:06:39.623383 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:39.635357 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:06:39.704484 tst mo_mt_call_osmux.py: using LAC 38925 06:06:39.824502 tst mo_mt_call_osmux.py: using RAC 165 06:06:39.944146 tst mo_mt_call_osmux.py: using CellId 38925 06:06:40.064569 tst mo_mt_call_osmux.py: using BVCI 38926 06:06:40.177944 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:40.189225 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:40.199948 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:40.210806 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:40.222303 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:06:40.233661 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:06:40.354750 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:06:40.475837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:40.985899 run create_hlr_db(pid=15670): Launched 06:06:41.119774 bus /sierra_2: Setting Powered False 06:06:42.184688 run create_hlr_db(pid=15670): Terminated: ok {rc=0} 06:06:42.641505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15672): Launched 06:06:42.970435 run osmo-hlr_10.42.42.2(pid=15673): Launched 06:06:43.095166 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:43.665736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15675): Launched 06:06:43.994694 run osmo-stp_10.42.42.5(pid=15676): Launched 06:06:44.120497 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:44.715793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15678): Launched 06:06:45.045572 run osmo-msc_10.42.42.6(pid=15679): Launched 06:06:45.228406 run osmo-stp_10.42.42.5(pid=15676): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15676)] 06:06:45.370123 run osmo-stp_10.42.42.5(pid=15676): stdout: | (launched: 2022-12-14_06:06:43.934927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:45.507286 run osmo-stp_10.42.42.5(pid=15676): stderr: | 20221214060644125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060644125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060644126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060644126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060644126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060644127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060644127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:45.644655 run osmo-stp_10.42.42.5(pid=15676): stdout: | (launched: 2022-12-14_06:06:43.934927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:45.776080 run osmo-stp_10.42.42.5(pid=15676): stderr: | 20221214060644125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060644125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060644126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060644126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060644126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060644127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060644127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:45.951018 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15676): Process ended prematurely: osmo-stp_10.42.42.5(pid=15676) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15676)] [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:06:45.961087 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:06:45.988773 run osmo-hlr_10.42.42.2(pid=15673): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15673)] 06:06:46.039930 run osmo-hlr_10.42.42.2(pid=15673): stdout: | (launched: 2022-12-14_06:06:42.910427) 06:06:46.092422 run osmo-hlr_10.42.42.2(pid=15673): stderr: | 20221214060643106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060643106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060643106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060643106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060643106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060643106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060643119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060643127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060643128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060643128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:46.165293 run osmo-msc_10.42.42.6(pid=15679): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15679)] 06:06:46.214176 run osmo-msc_10.42.42.6(pid=15679): stdout: | (launched: 2022-12-14_06:06:44.985923) 06:06:46.266728 run osmo-msc_10.42.42.6(pid=15679): stderr: | 20221214060645306 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060645306 DLGLOBAL DEBUG validating counter group 0x7f8c26f44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060645306 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060645306 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060645307 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060645307 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060645308 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060645309 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060645309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060645309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:46.318548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15672): Terminating (SIGTERM) 06:06:46.361814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15675): Terminating (SIGTERM) 06:06:46.406098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15678): Terminating (SIGTERM) 06:06:46.451717 --- ParallelTerminationStrategy: PID 15672 died... 06:06:46.472831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15672): Terminated: ok {rc=0} 06:06:46.520305 --- ParallelTerminationStrategy: PID 15675 died... 06:06:46.541400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15675): Terminated: ok {rc=0} 06:06:46.588318 --- ParallelTerminationStrategy: PID 15678 died... 06:06:46.608905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15678): Terminated: ok {rc=0} 06:06:46.698608 bus /sierra_3: Setting Powered False 06:06:47.797828 bus /sierra_3: Setting Powered False 06:06:48.910992 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:06:50.161280 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:50.167625 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:06:50.199149 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:06:50.226588 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:06:50.276579 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:06:50.308845 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:06:50.335442 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:06:50.886754 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:06:50.936823 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:50.947984 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:06:51.016386 tst mo_mt_call.py: using LAC 38926 06:06:51.137444 tst mo_mt_call.py: using RAC 166 06:06:51.266753 tst mo_mt_call.py: using CellId 38926 06:06:51.397375 tst mo_mt_call.py: using BVCI 38927 06:06:51.517069 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:51.529036 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:51.540628 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:51.552003 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:51.563475 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:51.574838 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:06:51.691445 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:06:51.811859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:52.324074 run create_hlr_db(pid=15684): Launched 06:06:52.458490 bus /sierra_2: Setting Powered False 06:06:53.522651 run create_hlr_db(pid=15684): Terminated: ok {rc=0} 06:06:53.961093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15686): Launched 06:06:54.270561 run osmo-hlr_10.42.42.2(pid=15687): Launched 06:06:54.389274 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:54.932858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15689): Launched 06:06:55.241558 run osmo-stp_10.42.42.5(pid=15690): Launched 06:06:55.359281 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:55.916261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15692): Launched 06:06:56.225696 run osmo-msc_10.42.42.6(pid=15693): Launched 06:06:56.399028 run osmo-stp_10.42.42.5(pid=15690): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15690)] 06:06:56.529857 run osmo-stp_10.42.42.5(pid=15690): stdout: | (launched: 2022-12-14_06:06:55.185271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:56.660071 run osmo-stp_10.42.42.5(pid=15690): stderr: | 20221214060655353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060655354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060655354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060655354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060655355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060655355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060655355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:56.788084 run osmo-stp_10.42.42.5(pid=15690): stdout: | (launched: 2022-12-14_06:06:55.185271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:56.910315 run osmo-stp_10.42.42.5(pid=15690): stderr: | 20221214060655353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060655354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060655354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060655354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060655355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060655355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060655355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:57.057197 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15690): Process ended prematurely: osmo-stp_10.42.42.5(pid=15690) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15690)] [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:06:57.066162 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:06:57.092528 run osmo-hlr_10.42.42.2(pid=15687): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15687)] 06:06:57.140459 run osmo-hlr_10.42.42.2(pid=15687): stdout: | (launched: 2022-12-14_06:06:54.214229) 06:06:57.189378 run osmo-hlr_10.42.42.2(pid=15687): stderr: | 20221214060654388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060654388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060654388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060654388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060654388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060654388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060654400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060654408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060654408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060654408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:57.258212 run osmo-msc_10.42.42.6(pid=15693): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15693)] 06:06:57.305304 run osmo-msc_10.42.42.6(pid=15693): stdout: | (launched: 2022-12-14_06:06:56.169309) 06:06:57.354816 run osmo-msc_10.42.42.6(pid=15693): stderr: | 20221214060656437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060656437 DLGLOBAL DEBUG validating counter group 0x7fece97b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060656437 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060656437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060656438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060656438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060656439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060656440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060656440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060656440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:57.404370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15686): Terminating (SIGTERM) 06:06:57.443917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15689): Terminating (SIGTERM) 06:06:57.483665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15692): Terminating (SIGTERM) 06:06:57.523535 --- ParallelTerminationStrategy: PID 15686 died... 06:06:57.543044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15686): Terminated: ok {rc=0} 06:06:57.586953 --- ParallelTerminationStrategy: PID 15689 died... 06:06:57.605774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15689): Terminated: ok {rc=0} 06:06:57.649469 --- ParallelTerminationStrategy: PID 15692 died... 06:06:57.668421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15692): Terminated: ok {rc=0} 06:06:57.751812 bus /sierra_3: Setting Powered False 06:06:58.848567 bus /sierra_3: Setting Powered False 06:06:59.963921 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:07:01.112200 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:07:01.125355 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:07:01.199621 tst mo_mt_call_osmux.py: using LAC 38927 06:07:01.326341 tst mo_mt_call_osmux.py: using RAC 167 06:07:01.486528 tst mo_mt_call_osmux.py: using CellId 38927 06:07:01.645838 tst mo_mt_call_osmux.py: using BVCI 38928 06:07:01.769421 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:07:01.781771 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:07:01.793859 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:07:01.805931 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:07:01.818014 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:07:01.830464 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:07:01.954550 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:07:02.105913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:02.641137 run create_hlr_db(pid=15695): Launched 06:07:02.775179 bus /sierra_2: Setting Powered False 06:07:03.839755 run create_hlr_db(pid=15695): Terminated: ok {rc=0} 06:07:04.297644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15697): Launched 06:07:04.626644 run osmo-hlr_10.42.42.2(pid=15698): Launched 06:07:04.750710 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:05.323780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15700): Launched 06:07:05.653821 run osmo-stp_10.42.42.5(pid=15701): Launched 06:07:05.778116 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:06.372296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15703): Launched 06:07:06.701868 run osmo-msc_10.42.42.6(pid=15704): Launched 06:07:06.884242 run osmo-stp_10.42.42.5(pid=15701): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15701)] 06:07:07.023579 run osmo-stp_10.42.42.5(pid=15701): stdout: | (launched: 2022-12-14_06:07:05.593523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:07.162622 run osmo-stp_10.42.42.5(pid=15701): stderr: | 20221214060705786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060705786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060705786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060705786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060705787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060705787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060705787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:07.299797 run osmo-stp_10.42.42.5(pid=15701): stdout: | (launched: 2022-12-14_06:07:05.593523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:07.430958 run osmo-stp_10.42.42.5(pid=15701): stderr: | 20221214060705786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060705786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060705786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060705786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060705787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060705787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060705787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:07.587479 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15701): Process ended prematurely: osmo-stp_10.42.42.5(pid=15701) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15701)] [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:07:07.597220 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:07:07.624731 run osmo-hlr_10.42.42.2(pid=15698): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15698)] 06:07:07.674324 run osmo-hlr_10.42.42.2(pid=15698): stdout: | (launched: 2022-12-14_06:07:04.567426) 06:07:07.725453 run osmo-hlr_10.42.42.2(pid=15698): stderr: | 20221214060704765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060704765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060704765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060704765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060704765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060704765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060704778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060704786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060704786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060704786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:07.796940 run osmo-msc_10.42.42.6(pid=15704): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15704)] 06:07:07.846328 run osmo-msc_10.42.42.6(pid=15704): stdout: | (launched: 2022-12-14_06:07:06.642182) 06:07:07.897472 run osmo-msc_10.42.42.6(pid=15704): stderr: | 20221214060706962 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060706962 DLGLOBAL DEBUG validating counter group 0x7f5a19fe7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060706962 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060706962 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060706963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060706963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060706964 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060706965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060706965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060706965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:07.949381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15697): Terminating (SIGTERM) 06:07:07.990806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15700): Terminating (SIGTERM) 06:07:08.032128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15703): Terminating (SIGTERM) 06:07:08.073702 --- ParallelTerminationStrategy: PID 15697 died... 06:07:08.093799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15697): Terminated: ok {rc=0} 06:07:08.139683 --- ParallelTerminationStrategy: PID 15700 died... 06:07:08.159321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15700): Terminated: ok {rc=0} 06:07:08.204854 --- ParallelTerminationStrategy: PID 15703 died... 06:07:08.224816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15703): Terminated: ok {rc=0} 06:07:08.311337 bus /sierra_3: Setting Powered False 06:07:09.409426 bus /sierra_3: Setting Powered False 06:07:10.523322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:07:11.777372 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:07:11.783562 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:07:11.816790 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:07:11.844514 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:07:11.902128 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:07:11.934407 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:07:11.961266 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:07:12.504758 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:07:12.555712 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:12.566877 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:07:12.634520 tst mo_mt_call.py: using LAC 38928 06:07:12.756848 tst mo_mt_call.py: using RAC 168 06:07:12.877356 tst mo_mt_call.py: using CellId 38928 06:07:12.996256 tst mo_mt_call.py: using BVCI 38929 06:07:13.107517 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:13.118573 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:13.129416 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:13.140045 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:13.151218 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:13.162652 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:07:13.282239 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:07:13.401774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:13.880377 run create_hlr_db(pid=15709): Launched 06:07:13.998997 bus /sierra_2: Setting Powered False 06:07:15.061363 run create_hlr_db(pid=15709): Terminated: ok {rc=0} 06:07:15.489665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15712): Launched 06:07:15.797961 run osmo-hlr_10.42.42.2(pid=15713): Launched 06:07:16.014101 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:16.686547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15715): Launched 06:07:17.038670 run osmo-stp_10.42.42.5(pid=15716): Launched 06:07:17.253975 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:17.851863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15718): Launched 06:07:18.160455 run osmo-msc_10.42.42.6(pid=15719): Launched 06:07:18.332488 run osmo-stp_10.42.42.5(pid=15716): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15716)] 06:07:18.463196 run osmo-stp_10.42.42.5(pid=15716): stdout: | (launched: 2022-12-14_06:07:16.976296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:18.594260 run osmo-stp_10.42.42.5(pid=15716): stderr: | 20221214060717286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060717286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060717286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060717287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060717287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060717287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060717287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:18.722658 run osmo-stp_10.42.42.5(pid=15716): stdout: | (launched: 2022-12-14_06:07:16.976296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:18.845619 run osmo-stp_10.42.42.5(pid=15716): stderr: | 20221214060717286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060717286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060717286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060717287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060717287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060717287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060717287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:18.992366 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15716): Process ended prematurely: osmo-stp_10.42.42.5(pid=15716) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15716)] [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:07:19.001467 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:07:19.027826 run osmo-hlr_10.42.42.2(pid=15713): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15713)] 06:07:19.075864 run osmo-hlr_10.42.42.2(pid=15713): stdout: | (launched: 2022-12-14_06:07:15.742083) 06:07:19.125270 run osmo-hlr_10.42.42.2(pid=15713): stderr: | 20221214060715938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060715939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060715939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060715939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060715939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060715939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060715955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060715971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060715971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060715971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:19.194092 run osmo-msc_10.42.42.6(pid=15719): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15719)] 06:07:19.241242 run osmo-msc_10.42.42.6(pid=15719): stdout: | (launched: 2022-12-14_06:07:18.104441) 06:07:19.290710 run osmo-msc_10.42.42.6(pid=15719): stderr: | 20221214060718372 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060718372 DLGLOBAL DEBUG validating counter group 0x7fa1c8b01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060718372 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060718372 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060718373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060718373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060718374 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060718375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060718375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060718375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:19.340390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15712): Terminating (SIGTERM) 06:07:19.380106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15715): Terminating (SIGTERM) 06:07:19.419681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15718): Terminating (SIGTERM) 06:07:19.459767 --- ParallelTerminationStrategy: PID 15712 died... 06:07:19.479464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15712): Terminated: ok {rc=0} 06:07:19.523892 --- ParallelTerminationStrategy: PID 15715 died... 06:07:19.543058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15715): Terminated: ok {rc=0} 06:07:19.587566 --- ParallelTerminationStrategy: PID 15718 died... 06:07:19.606912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15718): Terminated: ok {rc=0} 06:07:19.693808 bus /sierra_3: Setting Powered False 06:07:20.792583 bus /sierra_3: Setting Powered False 06:07:21.908300 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:07:23.055830 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:23.067717 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:07:23.138701 tst mo_mt_call_osmux.py: using LAC 38929 06:07:23.260367 tst mo_mt_call_osmux.py: using RAC 169 06:07:23.390293 tst mo_mt_call_osmux.py: using CellId 38929 06:07:23.519097 tst mo_mt_call_osmux.py: using BVCI 38930 06:07:23.639701 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:23.651183 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:23.662346 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:23.673537 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:23.684639 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:07:23.695929 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:07:23.813640 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:07:23.932653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:24.445492 run create_hlr_db(pid=15721): Launched 06:07:24.578958 bus /sierra_2: Setting Powered False 06:07:25.643640 run create_hlr_db(pid=15721): Terminated: ok {rc=0} 06:07:26.102142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15723): Launched 06:07:26.431548 run osmo-hlr_10.42.42.2(pid=15724): Launched 06:07:26.557030 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:27.131454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15726): Launched 06:07:27.461175 run osmo-stp_10.42.42.5(pid=15727): Launched 06:07:27.587176 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:28.188291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15729): Launched 06:07:28.518246 run osmo-msc_10.42.42.6(pid=15730): Launched 06:07:28.702078 run osmo-stp_10.42.42.5(pid=15727): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15727)] 06:07:28.840133 run osmo-stp_10.42.42.5(pid=15727): stdout: | (launched: 2022-12-14_06:07:27.401442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:28.979199 run osmo-stp_10.42.42.5(pid=15727): stderr: | 20221214060727590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060727590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060727590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060727591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060727591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060727591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060727591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:29.116884 run osmo-stp_10.42.42.5(pid=15727): stdout: | (launched: 2022-12-14_06:07:27.401442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:29.248064 run osmo-stp_10.42.42.5(pid=15727): stderr: | 20221214060727590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060727590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060727590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060727591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060727591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060727591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060727591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:29.405173 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15727): Process ended prematurely: osmo-stp_10.42.42.5(pid=15727) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15727)] [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:07:29.414878 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:07:29.442969 run osmo-hlr_10.42.42.2(pid=15724): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15724)] 06:07:29.493428 run osmo-hlr_10.42.42.2(pid=15724): stdout: | (launched: 2022-12-14_06:07:26.371917) 06:07:29.545561 run osmo-hlr_10.42.42.2(pid=15724): stderr: | 20221214060726568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060726568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060726568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060726568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060726568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060726568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060726581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060726590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060726590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060726590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:29.617891 run osmo-msc_10.42.42.6(pid=15730): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15730)] 06:07:29.668190 run osmo-msc_10.42.42.6(pid=15730): stdout: | (launched: 2022-12-14_06:07:28.458692) 06:07:29.720172 run osmo-msc_10.42.42.6(pid=15730): stderr: | 20221214060728782 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060728782 DLGLOBAL DEBUG validating counter group 0x7f65e35bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060728782 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060728782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060728782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060728782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060728784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060728784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060728785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060728785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:29.772620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15723): Terminating (SIGTERM) 06:07:29.814420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15726): Terminating (SIGTERM) 06:07:29.856013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15729): Terminating (SIGTERM) 06:07:29.898145 --- ParallelTerminationStrategy: PID 15723 died... 06:07:29.917752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15723): Terminated: ok {rc=0} 06:07:29.964157 --- ParallelTerminationStrategy: PID 15726 died... 06:07:29.983914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15726): Terminated: ok {rc=0} 06:07:30.030055 --- ParallelTerminationStrategy: PID 15729 died... 06:07:30.049819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15729): Terminated: ok {rc=0} 06:07:30.138235 bus /sierra_3: Setting Powered False 06:07:31.254791 bus /sierra_3: Setting Powered False 06:07:32.370841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:07:33.620675 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:07:33.627430 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:07:33.660432 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 06:07:33.688149 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 06:07:33.744031 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:07:33.777978 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 06:07:33.805643 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 06:07:34.350905 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 06:07:34.401814 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:34.413315 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:07:34.464115 tst mo_mt_call.py: using LAC 38930 06:07:34.595203 tst mo_mt_call.py: using RAC 170 06:07:34.717092 tst mo_mt_call.py: using CellId 38930 06:07:34.836848 tst mo_mt_call.py: using BVCI 38931 06:07:34.949073 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:34.960401 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:34.971550 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:34.982584 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:34.994054 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:35.005443 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:07:35.121987 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:07:35.244349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:35.754724 run create_hlr_db(pid=15735): Launched 06:07:35.887978 bus /sierra_2: Setting Powered False 06:07:36.953606 run create_hlr_db(pid=15735): Terminated: ok {rc=0} 06:07:37.392503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15737): Launched 06:07:37.702301 run osmo-hlr_10.42.42.2(pid=15738): Launched 06:07:37.819546 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:38.354636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15740): Launched 06:07:38.663995 run osmo-stp_10.42.42.5(pid=15741): Launched 06:07:38.785326 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:39.344697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15743): Launched 06:07:39.653213 run osmo-msc_10.42.42.6(pid=15744): Launched 06:07:39.828291 run osmo-stp_10.42.42.5(pid=15741): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15741)] 06:07:39.967854 run osmo-stp_10.42.42.5(pid=15741): stdout: | (launched: 2022-12-14_06:07:38.607685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:40.108357 run osmo-stp_10.42.42.5(pid=15741): stderr: | 20221214060738774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060738774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060738775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060738775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060738775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060738776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060738776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:40.245618 run osmo-stp_10.42.42.5(pid=15741): stdout: | (launched: 2022-12-14_06:07:38.607685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:40.378556 run osmo-stp_10.42.42.5(pid=15741): stderr: | 20221214060738774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060738774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060738775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060738775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060738775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060738776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060738776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:40.535738 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15741): Process ended prematurely: osmo-stp_10.42.42.5(pid=15741) [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15741)] [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 06:07:40.545777 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:07:40.573442 run osmo-hlr_10.42.42.2(pid=15738): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15738)] 06:07:40.623737 run osmo-hlr_10.42.42.2(pid=15738): stdout: | (launched: 2022-12-14_06:07:37.646065) 06:07:40.675243 run osmo-hlr_10.42.42.2(pid=15738): stderr: | 20221214060737820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060737820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060737820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060737821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060737821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060737821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060737833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060737843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060737843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060737843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:40.747702 run osmo-msc_10.42.42.6(pid=15744): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15744)] 06:07:40.797592 run osmo-msc_10.42.42.6(pid=15744): stdout: | (launched: 2022-12-14_06:07:39.596941) 06:07:40.848795 run osmo-msc_10.42.42.6(pid=15744): stderr: | 20221214060739865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060739865 DLGLOBAL DEBUG validating counter group 0x7fb29332fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060739865 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060739865 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060739865 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060739866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060739867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060739868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060739868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060739868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:40.900425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15737): Terminating (SIGTERM) 06:07:40.941869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15740): Terminating (SIGTERM) 06:07:40.983686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15743): Terminating (SIGTERM) 06:07:41.026230 --- ParallelTerminationStrategy: PID 15737 died... 06:07:41.046242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15737): Terminated: ok {rc=0} 06:07:41.092258 --- ParallelTerminationStrategy: PID 15740 died... 06:07:41.111791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15740): Terminated: ok {rc=0} 06:07:41.157552 --- ParallelTerminationStrategy: PID 15743 died... 06:07:41.177186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15743): Terminated: ok {rc=0} 06:07:41.264287 bus /sierra_3: Setting Powered False 06:07:42.362331 bus /sierra_3: Setting Powered False 06:07:43.477367 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 06:07:44.624860 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:44.637510 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:07:44.691336 tst mo_mt_call_osmux.py: using LAC 38931 06:07:44.821772 tst mo_mt_call_osmux.py: using RAC 171 06:07:44.951218 tst mo_mt_call_osmux.py: using CellId 38931 06:07:45.081501 tst mo_mt_call_osmux.py: using BVCI 38932 06:07:45.201140 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:45.212929 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:45.224605 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:45.236246 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:45.248070 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:45.259636 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:07:45.375508 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:07:45.497787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:46.034250 run create_hlr_db(pid=15746): Launched 06:07:46.183675 bus /sierra_2: Setting Powered False 06:07:47.248419 run create_hlr_db(pid=15746): Terminated: ok {rc=0} 06:07:47.710201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15748): Launched 06:07:48.040528 run osmo-hlr_10.42.42.2(pid=15749): Launched 06:07:48.166325 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:48.734290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15751): Launched 06:07:49.066139 run osmo-stp_10.42.42.5(pid=15752): Launched 06:07:49.191506 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:49.787308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15754): Launched 06:07:50.117754 run osmo-msc_10.42.42.6(pid=15755): Launched 06:07:50.301232 run osmo-stp_10.42.42.5(pid=15752): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15752)] 06:07:50.440166 run osmo-stp_10.42.42.5(pid=15752): stdout: | (launched: 2022-12-14_06:07:49.006126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:50.579649 run osmo-stp_10.42.42.5(pid=15752): stderr: | 20221214060749195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060749195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060749195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060749196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060749196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060749196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060749196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:50.717180 run osmo-stp_10.42.42.5(pid=15752): stdout: | (launched: 2022-12-14_06:07:49.006126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:50.849028 run osmo-stp_10.42.42.5(pid=15752): stderr: | 20221214060749195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060749195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060749195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060749196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060749196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060749196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060749196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:51.006802 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15752): Process ended prematurely: osmo-stp_10.42.42.5(pid=15752) [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15752)] [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 06:07:51.016538 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:07:51.044273 run osmo-hlr_10.42.42.2(pid=15749): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15749)] 06:07:51.094102 run osmo-hlr_10.42.42.2(pid=15749): stdout: | (launched: 2022-12-14_06:07:47.980477) 06:07:51.145620 run osmo-hlr_10.42.42.2(pid=15749): stderr: | 20221214060748176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060748176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060748176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060748176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060748176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060748176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060748188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060748197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060748197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060748197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:51.217182 run osmo-msc_10.42.42.6(pid=15755): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15755)] 06:07:51.266656 run osmo-msc_10.42.42.6(pid=15755): stdout: | (launched: 2022-12-14_06:07:50.057987) 06:07:51.317757 run osmo-msc_10.42.42.6(pid=15755): stderr: | 20221214060750378 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060750378 DLGLOBAL DEBUG validating counter group 0x7f9851c93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060750378 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060750378 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060750378 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060750378 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060750380 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060750380 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060750381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060750381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:51.369398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15748): Terminating (SIGTERM) 06:07:51.410518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15751): Terminating (SIGTERM) 06:07:51.451748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15754): Terminating (SIGTERM) 06:07:51.493263 --- ParallelTerminationStrategy: PID 15748 died... 06:07:51.513432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15748): Terminated: ok {rc=0} 06:07:51.559405 --- ParallelTerminationStrategy: PID 15751 died... 06:07:51.579004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15751): Terminated: ok {rc=0} 06:07:51.624585 --- ParallelTerminationStrategy: PID 15754 died... 06:07:51.644196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15754): Terminated: ok {rc=0} 06:07:51.731275 bus /sierra_3: Setting Powered False 06:07:52.829489 bus /sierra_3: Setting Powered False 06:07:53.945091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:trx-umtrx --------------------------------------------------------------------- 06:07:55.195954 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:07:55.201399 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:07:55.233615 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:07:55.261650 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 06:07:55.347337 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:07:55.380370 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:07:55.406961 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 06:07:55.986128 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 06:07:55.991470 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:56.002381 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:56.050787 tst emergency_mo_mt_call.py: using LAC 38932 06:07:56.179379 tst emergency_mo_mt_call.py: using RAC 172 06:07:56.313565 tst emergency_mo_mt_call.py: using CellId 38932 06:07:56.440646 tst emergency_mo_mt_call.py: using BVCI 38933 06:07:56.559095 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:56.570314 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:56.581400 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:56.592276 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:56.603524 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:56.614441 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:56.729230 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:56.850512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:57.325356 run create_hlr_db(pid=15760): Launched 06:07:57.442740 bus /sierra_2: Setting Powered False 06:07:58.503043 run create_hlr_db(pid=15760): Terminated: ok {rc=0} 06:07:58.928322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15762): Launched 06:07:59.253358 run osmo-hlr_10.42.42.2(pid=15763): Launched 06:07:59.377172 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:59.935819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15765): Launched 06:08:00.260356 run osmo-stp_10.42.42.5(pid=15766): Launched 06:08:00.394361 tst emergency_mo_mt_call.py: using MSISDN 8533 06:08:00.561213 run osmo-msc_10.42.42.6: Starting osmo-msc 06:08:01.158651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15768): Launched 06:08:01.503303 run osmo-msc_10.42.42.6(pid=15769): Launched 06:08:01.889057 run osmo-stp_10.42.42.5(pid=15766): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15766)] 06:08:02.193963 run osmo-stp_10.42.42.5(pid=15766): stdout: | (launched: 2022-12-14_06:08:00.201343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:02.331612 run osmo-stp_10.42.42.5(pid=15766): stderr: | 20221214060800390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060800390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060800390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060800391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060800391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060800391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060800391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:02.467245 run osmo-stp_10.42.42.5(pid=15766): stdout: | (launched: 2022-12-14_06:08:00.201343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:02.596800 run osmo-stp_10.42.42.5(pid=15766): stderr: | 20221214060800390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060800390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060800390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060800391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060800391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060800391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060800391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:02.752260 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15766): Process ended prematurely: osmo-stp_10.42.42.5(pid=15766) [trial-2400↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15766)] [trial-2400↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 06:08:02.761434 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 06:08:02.788573 run osmo-hlr_10.42.42.2(pid=15763): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15763)] 06:08:02.838285 run osmo-hlr_10.42.42.2(pid=15763): stdout: | (launched: 2022-12-14_06:07:59.194778) 06:08:02.889720 run osmo-hlr_10.42.42.2(pid=15763): stderr: | 20221214060759389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060759389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060759389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060759389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060759389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060759389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060759401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060759410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060759410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060759410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:02.962090 run osmo-msc_10.42.42.6(pid=15769): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15769)] 06:08:03.011857 run osmo-msc_10.42.42.6(pid=15769): stdout: | (launched: 2022-12-14_06:08:01.439651) 06:08:03.063373 run osmo-msc_10.42.42.6(pid=15769): stderr: | 20221214060801884 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060801884 DLGLOBAL DEBUG validating counter group 0x7f35ec0bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060801884 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060801886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060801886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060801886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060801888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060801889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060801889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060801889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:08:03.114960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15762): Terminating (SIGTERM) 06:08:03.156291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15765): Terminating (SIGTERM) 06:08:03.197998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15768): Terminating (SIGTERM) 06:08:03.240220 --- ParallelTerminationStrategy: PID 15762 died... 06:08:03.260431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15762): Terminated: ok {rc=0} 06:08:03.306349 --- ParallelTerminationStrategy: PID 15765 died... 06:08:03.325943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15765): Terminated: ok {rc=0} 06:08:03.371440 --- ParallelTerminationStrategy: PID 15768 died... 06:08:03.390786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15768): Terminated: ok {rc=0} 06:08:03.479124 bus /sierra_3: Setting Powered False 06:08:04.574469 bus /sierra_3: Setting Powered False 06:08:05.686390 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 06:08:06.773239 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:08:06.785178 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:06.835289 tst emergency_preemptive_call.py: using LAC 38933 06:08:06.957886 tst emergency_preemptive_call.py: using RAC 173 06:08:07.081125 tst emergency_preemptive_call.py: using CellId 38933 06:08:07.202256 tst emergency_preemptive_call.py: using BVCI 38934 06:08:07.321465 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:08:07.332606 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:08:07.343653 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:08:07.354582 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:08:07.365560 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:08:07.376414 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:07.494904 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:07.611366 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:07.730960 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:07.850120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:08.358045 run create_hlr_db(pid=15771): Launched 06:08:08.481551 bus /sierra_2: Setting Powered False 06:08:09.543166 run create_hlr_db(pid=15771): Terminated: ok {rc=0} 06:08:09.990087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15773): Launched 06:08:10.316084 run osmo-hlr_10.42.42.2(pid=15774): Launched 06:08:10.441678 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:11.008449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15776): Launched 06:08:11.334461 run osmo-stp_10.42.42.5(pid=15777): Launched 06:08:11.468149 tst emergency_preemptive_call.py: using MSISDN 8534 06:08:11.634875 run osmo-msc_10.42.42.6: Starting osmo-msc 06:08:12.218524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15779): Launched 06:08:12.542846 run osmo-msc_10.42.42.6(pid=15780): Launched 06:08:12.724649 run osmo-stp_10.42.42.5(pid=15777): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15777)] 06:08:12.861827 run osmo-stp_10.42.42.5(pid=15777): stdout: | (launched: 2022-12-14_06:08:11.275152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:12.999789 run osmo-stp_10.42.42.5(pid=15777): stderr: | 20221214060811465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060811465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060811466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060811466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060811467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060811467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060811467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:13.136648 run osmo-stp_10.42.42.5(pid=15777): stdout: | (launched: 2022-12-14_06:08:11.275152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:13.266465 run osmo-stp_10.42.42.5(pid=15777): stderr: | 20221214060811465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060811465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060811466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060811466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060811467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060811467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060811467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:13.421774 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15777): Process ended prematurely: osmo-stp_10.42.42.5(pid=15777) [trial-2400↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15777)] [trial-2400↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 06:08:13.430822 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 06:08:13.458313 run osmo-hlr_10.42.42.2(pid=15774): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15774)] 06:08:13.508304 run osmo-hlr_10.42.42.2(pid=15774): stdout: | (launched: 2022-12-14_06:08:10.256867) 06:08:13.559883 run osmo-hlr_10.42.42.2(pid=15774): stderr: | 20221214060810451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060810451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060810451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060810451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060810451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060810451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060810464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060810473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060810473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060810473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:13.632079 run osmo-msc_10.42.42.6(pid=15780): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15780)] 06:08:13.681910 run osmo-msc_10.42.42.6(pid=15780): stdout: | (launched: 2022-12-14_06:08:12.483642) 06:08:13.733452 run osmo-msc_10.42.42.6(pid=15780): stderr: | 20221214060812805 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214060812805 DLGLOBAL DEBUG validating counter group 0x7f04f52d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214060812805 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214060812805 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214060812806 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214060812806 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214060812808 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214060812808 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214060812808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214060812808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:08:13.785476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15773): Terminating (SIGTERM) 06:08:13.827153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15776): Terminating (SIGTERM) 06:08:13.869015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15779): Terminating (SIGTERM) 06:08:13.911056 --- ParallelTerminationStrategy: PID 15773 died... 06:08:13.931252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15773): Terminated: ok {rc=0} 06:08:13.977847 --- ParallelTerminationStrategy: PID 15776 died... 06:08:13.997602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15776): Terminated: ok {rc=0} 06:08:14.043663 --- ParallelTerminationStrategy: PID 15779 died... 06:08:14.063390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15779): Terminated: ok {rc=0} 06:08:14.150933 bus /sierra_9: Setting Powered False 06:08:15.248773 bus /sierra_9: Setting Powered False 06:08:16.365185 bus /sierra_8: Setting Powered False 06:08:17.464038 bus /sierra_8: Setting Powered False 06:08:18.579335 bus /sierra_3: Setting Powered False 06:08:19.677838 bus /sierra_3: Setting Powered False 06:08:20.796550 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx --------------------------------------------------------------------- 06:08:22.075434 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:08:22.080010 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:08:22.113226 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 06:08:22.152663 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 06:08:22.240796 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:08:22.273707 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 06:08:22.312815 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 06:08:22.904454 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 06:08:22.958475 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:22.969523 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:23.021587 tst cs_paging_gprs_active.py: using LAC 38934 06:08:23.151673 tst cs_paging_gprs_active.py: using RAC 174 06:08:23.279235 tst cs_paging_gprs_active.py: using CellId 38934 06:08:23.400272 tst cs_paging_gprs_active.py: using BVCI 38935 06:08:23.512796 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.523637 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.534285 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.544738 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.555777 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.566522 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.577367 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.587840 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.598534 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:23.716285 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:23.836807 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:08:24.061881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:24.392906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15785): Launched 06:08:24.680006 run iperf3-srv_10.42.42.10(pid=15786): Launched 06:08:24.803611 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:08:25.027960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:25.360516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15787): Launched 06:08:25.646907 run iperf3-srv_10.42.42.10(pid=15788): Launched 06:08:25.770091 tst cs_paging_gprs_active.py:38: start network... 06:08:25.993764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:26.505386 run create_hlr_db(pid=15789): Launched 06:08:26.639615 bus /sierra_2: Setting Powered False 06:08:27.704536 run create_hlr_db(pid=15789): Terminated: ok {rc=0} 06:08:28.163693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15791): Launched 06:08:28.493983 run osmo-hlr_10.42.42.2(pid=15792): Launched 06:08:28.619763 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:29.192331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15794): Launched 06:08:29.522212 run osmo-stp_10.42.42.5(pid=15795): Launched 06:08:29.648439 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:30.218576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15797): Launched 06:08:30.344681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:30.624595 run patchelf(pid=15798): Launched 06:08:30.807795 run osmo-stp_10.42.42.5(pid=15795): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15795)] 06:08:30.959832 run osmo-stp_10.42.42.5(pid=15795): stdout: | (launched: 2022-12-14_06:08:29.462207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:31.104438 run osmo-stp_10.42.42.5(pid=15795): stderr: | 20221214060829651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060829651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060829652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060829652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060829653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060829653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060829653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:31.249614 run osmo-stp_10.42.42.5(pid=15795): stdout: | (launched: 2022-12-14_06:08:29.462207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:31.387278 run osmo-stp_10.42.42.5(pid=15795): stderr: | 20221214060829651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060829651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060829652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060829652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060829653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060829653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060829653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:31.550810 run patchelf(pid=15798): Terminating (SIGINT) 06:08:31.739789 run patchelf(pid=15798): Terminated: ok {rc=0} 06:08:31.875910 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15795): Process ended prematurely: osmo-stp_10.42.42.5(pid=15795) [trial-2400↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15795)] [trial-2400↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 06:08:31.887418 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 06:08:31.916925 run osmo-hlr_10.42.42.2(pid=15792): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15792)] 06:08:31.968317 run osmo-hlr_10.42.42.2(pid=15792): stdout: | (launched: 2022-12-14_06:08:28.434026) 06:08:32.021881 run osmo-hlr_10.42.42.2(pid=15792): stderr: | 20221214060828630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060828630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060828630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060828630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060828630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060828630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060828642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060828653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060828653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060828653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:32.075749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15785): Terminating (SIGTERM) 06:08:32.118366 run iperf3-srv_10.42.42.10(pid=15786): Terminating (SIGTERM) 06:08:32.160713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15787): Terminating (SIGTERM) 06:08:32.203143 run iperf3-srv_10.42.42.10(pid=15788): Terminating (SIGTERM) 06:08:32.244782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15791): Terminating (SIGTERM) 06:08:32.286833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15794): Terminating (SIGTERM) 06:08:32.328540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15797): Terminating (SIGTERM) 06:08:32.370580 --- ParallelTerminationStrategy: PID 15785 died... 06:08:32.390619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15785): Terminated: ok {rc=0} 06:08:32.436819 --- ParallelTerminationStrategy: PID 15786 died... 06:08:32.456797 run iperf3-srv_10.42.42.10(pid=15786): Terminated {rc=256} 06:08:32.502562 --- ParallelTerminationStrategy: PID 15787 died... 06:08:32.522228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15787): Terminated: ok {rc=0} 06:08:32.568334 --- ParallelTerminationStrategy: PID 15788 died... 06:08:32.587983 run iperf3-srv_10.42.42.10(pid=15788): Terminated {rc=256} 06:08:32.633942 --- ParallelTerminationStrategy: PID 15791 died... 06:08:32.653389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15791): Terminated: ok {rc=0} 06:08:32.699286 --- ParallelTerminationStrategy: PID 15794 died... 06:08:32.718992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15794): Terminated: ok {rc=0} 06:08:32.764941 --- ParallelTerminationStrategy: PID 15797 died... 06:08:32.784568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15797): Terminated: ok {rc=0} 06:08:32.871489 bus /gobi_0: Setting Powered False 06:08:33.970184 bus /gobi_0: Setting Powered False 06:08:35.085375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx iperf3.py ---------------------------------------------- 06:08:36.234695 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.246627 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:36.299623 tst iperf3.py: using LAC 38935 06:08:36.428485 tst iperf3.py: using RAC 175 06:08:36.557388 tst iperf3.py: using CellId 38935 06:08:36.687726 tst iperf3.py: using BVCI 38936 06:08:36.807924 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.819121 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.830119 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.841059 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.851849 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.862684 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.873738 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.884602 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:36.895616 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:37.013131 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:08:37.223928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:37.536481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15799): Launched 06:08:37.807310 run iperf3-srv_10.42.42.10(pid=15800): Launched 06:08:37.923659 tst iperf3.py:8: start network... 06:08:38.132912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:38.612604 run create_hlr_db(pid=15801): Launched 06:08:38.749196 bus /gobi_6: Setting Powered False 06:08:39.813749 run create_hlr_db(pid=15801): Terminated: ok {rc=0} 06:08:40.253999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15803): Launched 06:08:40.564291 run osmo-hlr_10.42.42.2(pid=15804): Launched 06:08:40.682577 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:41.223032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15806): Launched 06:08:41.532781 run osmo-stp_10.42.42.5(pid=15807): Launched 06:08:41.651456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:42.188344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15809): Launched 06:08:42.307418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:42.570071 run patchelf(pid=15810): Launched 06:08:42.743116 run osmo-stp_10.42.42.5(pid=15807): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15807)] 06:08:42.874672 run osmo-stp_10.42.42.5(pid=15807): stdout: | (launched: 2022-12-14_06:08:41.476001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:43.007930 run osmo-stp_10.42.42.5(pid=15807): stderr: | 20221214060841645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060841645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060841646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060841646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060841646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060841647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060841647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:43.141346 run osmo-stp_10.42.42.5(pid=15807): stdout: | (launched: 2022-12-14_06:08:41.476001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:43.269224 run osmo-stp_10.42.42.5(pid=15807): stderr: | 20221214060841645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060841645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060841646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060841646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060841646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060841647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060841647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:43.420028 run patchelf(pid=15810): Terminating (SIGINT) 06:08:43.594118 run patchelf(pid=15810): Terminated: ok {rc=0} 06:08:43.719949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15807): Process ended prematurely: osmo-stp_10.42.42.5(pid=15807) [trial-2400↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15807)] [trial-2400↪gprs:trx-umtrx↪iperf3.py:8] 06:08:43.729481 tst iperf3.py:8: Test FAILED (7.5 sec) 06:08:43.756439 run osmo-hlr_10.42.42.2(pid=15804): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15804)] 06:08:43.804419 run osmo-hlr_10.42.42.2(pid=15804): stdout: | (launched: 2022-12-14_06:08:40.507451) 06:08:43.853789 run osmo-hlr_10.42.42.2(pid=15804): stderr: | 20221214060840681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060840681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060840681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060840681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060840681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060840681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060840693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060840701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060840701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060840701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:43.903656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15799): Terminating (SIGTERM) 06:08:43.944086 run iperf3-srv_10.42.42.10(pid=15800): Terminating (SIGTERM) 06:08:43.984169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15803): Terminating (SIGTERM) 06:08:44.024302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15806): Terminating (SIGTERM) 06:08:44.064372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15809): Terminating (SIGTERM) 06:08:44.104895 --- ParallelTerminationStrategy: PID 15799 died... 06:08:44.124660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15799): Terminated: ok {rc=0} 06:08:44.169232 --- ParallelTerminationStrategy: PID 15800 died... 06:08:44.188258 run iperf3-srv_10.42.42.10(pid=15800): Terminated {rc=256} 06:08:44.232306 --- ParallelTerminationStrategy: PID 15803 died... 06:08:44.251422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15803): Terminated: ok {rc=0} 06:08:44.295630 --- ParallelTerminationStrategy: PID 15806 died... 06:08:44.314758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15806): Terminated: ok {rc=0} 06:08:44.359024 --- ParallelTerminationStrategy: PID 15809 died... 06:08:44.378085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15809): Terminated: ok {rc=0} 06:08:44.464190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 06:08:45.612277 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:45.623681 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:45.674486 tst iperf3m4.py: using LAC 38936 06:08:45.798320 tst iperf3m4.py: using RAC 176 06:08:45.957238 tst iperf3m4.py: using CellId 38936 06:08:46.084002 tst iperf3m4.py: using BVCI 38937 06:08:46.201294 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.213063 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.224573 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.236232 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.249157 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.262718 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.276080 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.287955 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:46.299703 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:46.422686 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:46.558289 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:46.711775 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:46.851633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:08:47.148723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:47.509198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15811): Launched 06:08:47.779845 run iperf3-srv_10.42.42.10(pid=15812): Launched 06:08:47.896165 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:08:48.105667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:48.417765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15813): Launched 06:08:48.687634 run iperf3-srv_10.42.42.10(pid=15814): Launched 06:08:48.804783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:08:49.014387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:49.327158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15815): Launched 06:08:49.598585 run iperf3-srv_10.42.42.10(pid=15816): Launched 06:08:49.714892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:08:49.924295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:50.237783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15817): Launched 06:08:50.508300 run iperf3-srv_10.42.42.10(pid=15818): Launched 06:08:50.624774 tst iperf3m4.py:8: start network... 06:08:50.833818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:51.318637 run create_hlr_db(pid=15819): Launched 06:08:51.437585 bus /gobi_6: Setting Powered False 06:08:52.501400 run create_hlr_db(pid=15819): Terminated: ok {rc=0} 06:08:52.961152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15821): Launched 06:08:53.292069 run osmo-hlr_10.42.42.2(pid=15822): Launched 06:08:53.419268 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:53.990523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15824): Launched 06:08:54.322300 run osmo-stp_10.42.42.5(pid=15825): Launched 06:08:54.448017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:55.021369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15827): Launched 06:08:55.148083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:55.429719 run patchelf(pid=15828): Launched 06:08:55.613650 run osmo-stp_10.42.42.5(pid=15825): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15825)] 06:08:55.753440 run osmo-stp_10.42.42.5(pid=15825): stdout: | (launched: 2022-12-14_06:08:54.261692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:55.894945 run osmo-stp_10.42.42.5(pid=15825): stderr: | 20221214060854451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060854451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060854451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060854452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060854452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060854452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060854452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:56.037164 run osmo-stp_10.42.42.5(pid=15825): stdout: | (launched: 2022-12-14_06:08:54.261692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:56.172828 run osmo-stp_10.42.42.5(pid=15825): stderr: | 20221214060854451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060854451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060854451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060854452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060854452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060854452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060854452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:56.333805 run patchelf(pid=15828): Terminating (SIGINT) 06:08:56.518560 run patchelf(pid=15828): Terminated: ok {rc=0} 06:08:56.652041 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15825): Process ended prematurely: osmo-stp_10.42.42.5(pid=15825) [trial-2400↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15825)] [trial-2400↪gprs:trx-umtrx↪iperf3m4.py:8] 06:08:56.662179 tst iperf3m4.py:8: Test FAILED (11.1 sec) 06:08:56.690399 run osmo-hlr_10.42.42.2(pid=15822): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15822)] 06:08:56.739877 run osmo-hlr_10.42.42.2(pid=15822): stdout: | (launched: 2022-12-14_06:08:53.232124) 06:08:56.790985 run osmo-hlr_10.42.42.2(pid=15822): stderr: | 20221214060853424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060853425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060853425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060853425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060853425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060853425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060853437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060853445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060853445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060853446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:56.842341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15811): Terminating (SIGTERM) 06:08:56.883683 run iperf3-srv_10.42.42.10(pid=15812): Terminating (SIGTERM) 06:08:56.924822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15813): Terminating (SIGTERM) 06:08:56.966582 run iperf3-srv_10.42.42.10(pid=15814): Terminating (SIGTERM) 06:08:57.009405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15815): Terminating (SIGTERM) 06:08:57.051311 run iperf3-srv_10.42.42.10(pid=15816): Terminating (SIGTERM) 06:08:57.091113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15817): Terminating (SIGTERM) 06:08:57.131175 run iperf3-srv_10.42.42.10(pid=15818): Terminating (SIGTERM) 06:08:57.170874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15821): Terminating (SIGTERM) 06:08:57.210798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15824): Terminating (SIGTERM) 06:08:57.250448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15827): Terminating (SIGTERM) 06:08:57.290411 --- ParallelTerminationStrategy: PID 15811 died... 06:08:57.310222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15811): Terminated: ok {rc=0} 06:08:57.354970 --- ParallelTerminationStrategy: PID 15812 died... 06:08:57.374440 run iperf3-srv_10.42.42.10(pid=15812): Terminated {rc=256} 06:08:57.418598 --- ParallelTerminationStrategy: PID 15813 died... 06:08:57.437952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15813): Terminated: ok {rc=0} 06:08:57.482167 --- ParallelTerminationStrategy: PID 15814 died... 06:08:57.501377 run iperf3-srv_10.42.42.10(pid=15814): Terminated {rc=256} 06:08:57.545332 --- ParallelTerminationStrategy: PID 15815 died... 06:08:57.564595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15815): Terminated: ok {rc=0} 06:08:57.608613 --- ParallelTerminationStrategy: PID 15816 died... 06:08:57.627940 run iperf3-srv_10.42.42.10(pid=15816): Terminated {rc=256} 06:08:57.671936 --- ParallelTerminationStrategy: PID 15817 died... 06:08:57.691096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15817): Terminated: ok {rc=0} 06:08:57.735319 --- ParallelTerminationStrategy: PID 15818 died... 06:08:57.754656 run iperf3-srv_10.42.42.10(pid=15818): Terminated {rc=256} 06:08:57.798786 --- ParallelTerminationStrategy: PID 15821 died... 06:08:57.818277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15821): Terminated: ok {rc=0} 06:08:57.862693 --- ParallelTerminationStrategy: PID 15824 died... 06:08:57.882358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15824): Terminated: ok {rc=0} 06:08:57.926461 --- ParallelTerminationStrategy: PID 15827 died... 06:08:57.945876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15827): Terminated: ok {rc=0} 06:08:58.032109 bus /gobi_4: Setting Powered False 06:08:59.130166 bus /gobi_4: Setting Powered False 06:09:00.244198 bus /gobi_1: Setting Powered False 06:09:01.364310 bus /gobi_1: Setting Powered False 06:09:02.526680 bus /gobi_0: Setting Powered False 06:09:03.646634 bus /gobi_0: Setting Powered False 06:09:04.765856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx ping.py ---------------------------------------------- 06:09:05.873072 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:05.885555 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:09:05.944458 tst ping.py: using LAC 38937 06:09:06.080179 tst ping.py: using RAC 177 06:09:06.212526 tst ping.py: using CellId 38937 06:09:06.342691 tst ping.py: using BVCI 38938 06:09:06.466730 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.478383 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.489944 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.501821 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.513540 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.525421 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.537271 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:06.548868 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:09:06.673185 tst ping.py:19: start network... 06:09:06.901064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:07.422805 run create_hlr_db(pid=16101): Launched 06:09:07.614123 bus /gobi_6: Setting Powered False 06:09:08.676325 run create_hlr_db(pid=16101): Terminated: ok {rc=0} 06:09:09.124081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16103): Launched 06:09:09.460348 run osmo-hlr_10.42.42.2(pid=16104): Launched 06:09:09.702360 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:10.429441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16106): Launched 06:09:10.764901 run osmo-stp_10.42.42.5(pid=16107): Launched 06:09:11.010739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:11.715748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16109): Launched 06:09:11.850827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:12.125860 run patchelf(pid=16110): Launched 06:09:12.318477 run osmo-stp_10.42.42.5(pid=16107): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16107)] 06:09:12.456192 run osmo-stp_10.42.42.5(pid=16107): stdout: | (launched: 2022-12-14_06:09:10.704056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:12.594741 run osmo-stp_10.42.42.5(pid=16107): stderr: | 20221214060911033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060911033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060911034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060911034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060911035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060911035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060911035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:12.733699 run osmo-stp_10.42.42.5(pid=16107): stdout: | (launched: 2022-12-14_06:09:10.704056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:12.866892 run osmo-stp_10.42.42.5(pid=16107): stderr: | 20221214060911033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060911033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060911034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060911034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060911035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060911035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060911035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:13.022105 run patchelf(pid=16110): Terminating (SIGINT) 06:09:13.202936 run patchelf(pid=16110): Terminated: ok {rc=0} 06:09:13.333371 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16107): Process ended prematurely: osmo-stp_10.42.42.5(pid=16107) [trial-2400↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16107)] [trial-2400↪gprs:trx-umtrx↪ping.py:22] 06:09:13.344136 tst ping.py:22: Test FAILED (7.5 sec) 06:09:13.373032 run osmo-hlr_10.42.42.2(pid=16104): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16104)] 06:09:13.424858 run osmo-hlr_10.42.42.2(pid=16104): stdout: | (launched: 2022-12-14_06:09:09.397789) 06:09:13.479814 run osmo-hlr_10.42.42.2(pid=16104): stderr: | 20221214060909739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060909739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060909739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060909739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060909739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060909739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060909757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060909765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060909765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060909766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:13.533569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16103): Terminating (SIGTERM) 06:09:13.575917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16106): Terminating (SIGTERM) 06:09:13.621767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16109): Terminating (SIGTERM) 06:09:13.668296 --- ParallelTerminationStrategy: PID 16103 died... 06:09:13.689906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16103): Terminated: ok {rc=0} 06:09:13.738366 --- ParallelTerminationStrategy: PID 16106 died... 06:09:13.759370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16106): Terminated: ok {rc=0} 06:09:13.806729 --- ParallelTerminationStrategy: PID 16109 died... 06:09:13.828073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16109): Terminated: ok {rc=0} 06:09:13.918905 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 06:09:15.009899 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.022503 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:09:15.074719 tst ping_idle_ping.py: using LAC 38938 06:09:15.203408 tst ping_idle_ping.py: using RAC 178 06:09:15.331997 tst ping_idle_ping.py: using CellId 38938 06:09:15.459926 tst ping_idle_ping.py: using BVCI 38939 06:09:15.578265 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.590383 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.602137 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.613727 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.626655 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.639619 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.652740 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:09:15.666701 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:09:15.788879 tst ping_idle_ping.py:24: start network... 06:09:16.074573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:16.667323 run create_hlr_db(pid=16111): Launched 06:09:16.860515 bus /gobi_6: Setting Powered False 06:09:17.947095 run create_hlr_db(pid=16111): Terminated: ok {rc=0} 06:09:18.426294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16113): Launched 06:09:18.776828 run osmo-hlr_10.42.42.2(pid=16114): Launched 06:09:19.027927 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:19.754058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16116): Launched 06:09:20.092862 run osmo-stp_10.42.42.5(pid=16117): Launched 06:09:20.344429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:21.046924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16119): Launched 06:09:21.183133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:21.460833 run patchelf(pid=16120): Launched 06:09:21.655806 run osmo-stp_10.42.42.5(pid=16117): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16117)] 06:09:21.793553 run osmo-stp_10.42.42.5(pid=16117): stdout: | (launched: 2022-12-14_06:09:20.030035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:21.933562 run osmo-stp_10.42.42.5(pid=16117): stderr: | 20221214060920370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060920370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060920370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060920371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060920371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060920371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060920371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:22.073882 run osmo-stp_10.42.42.5(pid=16117): stdout: | (launched: 2022-12-14_06:09:20.030035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:22.205429 run osmo-stp_10.42.42.5(pid=16117): stderr: | 20221214060920370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060920370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060920370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060920371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060920371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060920371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060920371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:22.363297 run patchelf(pid=16120): Terminating (SIGINT) 06:09:22.543953 run patchelf(pid=16120): Terminated: ok {rc=0} 06:09:22.676620 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16117): Process ended prematurely: osmo-stp_10.42.42.5(pid=16117) [trial-2400↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16117)] [trial-2400↪gprs:trx-umtrx↪ping_idle_ping.py:27] 06:09:22.689628 tst ping_idle_ping.py:27: Test FAILED (7.7 sec) 06:09:22.718336 run osmo-hlr_10.42.42.2(pid=16114): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16114)] 06:09:22.772085 run osmo-hlr_10.42.42.2(pid=16114): stdout: | (launched: 2022-12-14_06:09:18.712207) 06:09:22.826451 run osmo-hlr_10.42.42.2(pid=16114): stderr: | 20221214060919059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060919059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060919059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060919059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060919059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060919059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060919076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060919092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060919092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060919092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:22.881061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16113): Terminating (SIGTERM) 06:09:22.923443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16116): Terminating (SIGTERM) 06:09:22.969937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16119): Terminating (SIGTERM) 06:09:23.015631 --- ParallelTerminationStrategy: PID 16113 died... 06:09:23.037626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16113): Terminated: ok {rc=0} 06:09:23.087216 --- ParallelTerminationStrategy: PID 16116 died... 06:09:23.108245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16116): Terminated: ok {rc=0} 06:09:23.155805 --- ParallelTerminationStrategy: PID 16119 died... 06:09:23.177104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16119): Terminated: ok {rc=0} 06:09:23.268400 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 06:09:24.568500 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:09:24.573872 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:09:24.605884 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:09:24.644593 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:09:24.729696 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:09:24.761872 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:09:24.800053 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:09:25.394812 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:09:25.446215 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:25.457148 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:25.505281 tst cs_paging_gprs_active.py: using LAC 38939 06:09:25.630408 tst cs_paging_gprs_active.py: using RAC 179 06:09:25.753770 tst cs_paging_gprs_active.py: using CellId 38939 06:09:25.878599 tst cs_paging_gprs_active.py: using BVCI 38940 06:09:25.994766 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.005863 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.016536 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.027281 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.038225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.049079 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.060177 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.071056 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:26.082189 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:26.203271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:26.322885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:09:26.537413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:26.857180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16127): Launched 06:09:27.134187 run iperf3-srv_10.42.42.10(pid=16128): Launched 06:09:27.253190 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:09:27.466513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:27.786307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16129): Launched 06:09:28.063759 run iperf3-srv_10.42.42.10(pid=16130): Launched 06:09:28.182576 tst cs_paging_gprs_active.py:38: start network... 06:09:28.395084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:28.886485 run create_hlr_db(pid=16131): Launched 06:09:29.006992 bus /gobi_6: Setting Powered False 06:09:30.069867 run create_hlr_db(pid=16131): Terminated: ok {rc=0} 06:09:30.511020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16133): Launched 06:09:30.830686 run osmo-hlr_10.42.42.2(pid=16134): Launched 06:09:31.087301 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:31.893717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16136): Launched 06:09:32.250940 run osmo-stp_10.42.42.5(pid=16137): Launched 06:09:32.443053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:32.987199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16139): Launched 06:09:33.108051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:33.375263 run patchelf(pid=16140): Launched 06:09:33.550868 run osmo-stp_10.42.42.5(pid=16137): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16137)] 06:09:33.685321 run osmo-stp_10.42.42.5(pid=16137): stdout: | (launched: 2022-12-14_06:09:32.184793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:33.820538 run osmo-stp_10.42.42.5(pid=16137): stderr: | 20221214060932416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060932416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060932416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060932417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060932417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060932417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060932417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:33.955484 run osmo-stp_10.42.42.5(pid=16137): stdout: | (launched: 2022-12-14_06:09:32.184793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:34.085142 run osmo-stp_10.42.42.5(pid=16137): stderr: | 20221214060932416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060932416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060932416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060932417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060932417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060932417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060932417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:34.237616 run patchelf(pid=16140): Terminating (SIGINT) 06:09:34.415008 run patchelf(pid=16140): Terminated: ok {rc=0} 06:09:34.542618 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16137): Process ended prematurely: osmo-stp_10.42.42.5(pid=16137) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16137)] [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:09:34.552259 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 06:09:34.579525 run osmo-hlr_10.42.42.2(pid=16134): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16134)] 06:09:34.627621 run osmo-hlr_10.42.42.2(pid=16134): stdout: | (launched: 2022-12-14_06:09:30.770836) 06:09:34.677265 run osmo-hlr_10.42.42.2(pid=16134): stderr: | 20221214060931073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060931073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060931073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060931073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060931073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060931073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060931089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060931100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060931101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060931101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:34.727236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16127): Terminating (SIGTERM) 06:09:34.767239 run iperf3-srv_10.42.42.10(pid=16128): Terminating (SIGTERM) 06:09:34.807267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16129): Terminating (SIGTERM) 06:09:34.847207 run iperf3-srv_10.42.42.10(pid=16130): Terminating (SIGTERM) 06:09:34.887013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16133): Terminating (SIGTERM) 06:09:34.927106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16136): Terminating (SIGTERM) 06:09:34.966870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16139): Terminating (SIGTERM) 06:09:35.007179 --- ParallelTerminationStrategy: PID 16127 died... 06:09:35.026631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16127): Terminated: ok {rc=0} 06:09:35.070771 --- ParallelTerminationStrategy: PID 16128 died... 06:09:35.089694 run iperf3-srv_10.42.42.10(pid=16128): Terminated {rc=256} 06:09:35.133703 --- ParallelTerminationStrategy: PID 16129 died... 06:09:35.152612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16129): Terminated: ok {rc=0} 06:09:35.196607 --- ParallelTerminationStrategy: PID 16130 died... 06:09:35.215482 run iperf3-srv_10.42.42.10(pid=16130): Terminated {rc=256} 06:09:35.259423 --- ParallelTerminationStrategy: PID 16133 died... 06:09:35.278484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16133): Terminated: ok {rc=0} 06:09:35.322676 --- ParallelTerminationStrategy: PID 16136 died... 06:09:35.341728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16136): Terminated: ok {rc=0} 06:09:35.385764 --- ParallelTerminationStrategy: PID 16139 died... 06:09:35.404731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16139): Terminated: ok {rc=0} 06:09:35.491354 bus /gobi_0: Setting Powered False 06:09:36.591181 bus /gobi_0: Setting Powered False 06:09:37.706069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:09:38.858179 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:38.870550 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:38.925396 tst iperf3.py: using LAC 38940 06:09:39.058783 tst iperf3.py: using RAC 180 06:09:39.190085 tst iperf3.py: using CellId 38940 06:09:39.321459 tst iperf3.py: using BVCI 38941 06:09:39.439610 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.450874 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.461875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.472823 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.484774 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.496168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.507852 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.519275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:39.531093 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:39.650467 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:09:39.865904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:40.185466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16141): Launched 06:09:40.461702 run iperf3-srv_10.42.42.10(pid=16142): Launched 06:09:40.581897 tst iperf3.py:8: start network... 06:09:40.794363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:41.283614 run create_hlr_db(pid=16143): Launched 06:09:41.403136 bus /gobi_6: Setting Powered False 06:09:42.465174 run create_hlr_db(pid=16143): Terminated: ok {rc=0} 06:09:42.922468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16145): Launched 06:09:43.260544 run osmo-hlr_10.42.42.2(pid=16146): Launched 06:09:43.389255 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:43.980464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16148): Launched 06:09:44.317298 run osmo-stp_10.42.42.5(pid=16149): Launched 06:09:44.445263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:45.024765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16151): Launched 06:09:45.153485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:45.438373 run patchelf(pid=16152): Launched 06:09:45.624091 run osmo-stp_10.42.42.5(pid=16149): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16149)] 06:09:45.765739 run osmo-stp_10.42.42.5(pid=16149): stdout: | (launched: 2022-12-14_06:09:44.255550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:45.929928 run osmo-stp_10.42.42.5(pid=16149): stderr: | 20221214060944450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060944450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060944451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060944451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060944452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060944452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060944452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:46.082883 run osmo-stp_10.42.42.5(pid=16149): stdout: | (launched: 2022-12-14_06:09:44.255550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:46.223763 run osmo-stp_10.42.42.5(pid=16149): stderr: | 20221214060944450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060944450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060944451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060944451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060944452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060944452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060944452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:46.391407 run patchelf(pid=16152): Terminating (SIGINT) 06:09:46.585118 run patchelf(pid=16152): Terminated: ok {rc=0} 06:09:46.724177 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16149): Process ended prematurely: osmo-stp_10.42.42.5(pid=16149) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16149)] [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 06:09:46.735352 tst iperf3.py:8: Test FAILED (7.9 sec) 06:09:46.765435 run osmo-hlr_10.42.42.2(pid=16146): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16146)] 06:09:46.816788 run osmo-hlr_10.42.42.2(pid=16146): stdout: | (launched: 2022-12-14_06:09:43.198411) 06:09:46.870169 run osmo-hlr_10.42.42.2(pid=16146): stderr: | 20221214060943400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060943400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060943400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060943400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060943400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060943400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060943413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060943423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060943423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060943423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:46.923657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16141): Terminating (SIGTERM) 06:09:46.967132 run iperf3-srv_10.42.42.10(pid=16142): Terminating (SIGTERM) 06:09:47.013430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16145): Terminating (SIGTERM) 06:09:47.056782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16148): Terminating (SIGTERM) 06:09:47.099634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16151): Terminating (SIGTERM) 06:09:47.142512 --- ParallelTerminationStrategy: PID 16141 died... 06:09:47.162726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16141): Terminated: ok {rc=0} 06:09:47.209810 --- ParallelTerminationStrategy: PID 16142 died... 06:09:47.229595 run iperf3-srv_10.42.42.10(pid=16142): Terminated {rc=256} 06:09:47.275641 --- ParallelTerminationStrategy: PID 16145 died... 06:09:47.295416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16145): Terminated: ok {rc=0} 06:09:47.341623 --- ParallelTerminationStrategy: PID 16148 died... 06:09:47.361404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16148): Terminated: ok {rc=0} 06:09:47.407666 --- ParallelTerminationStrategy: PID 16151 died... 06:09:47.427291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16151): Terminated: ok {rc=0} 06:09:47.515754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:09:48.667934 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:48.680101 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:48.731618 tst iperf3m4.py: using LAC 38941 06:09:48.864757 tst iperf3m4.py: using RAC 181 06:09:48.996370 tst iperf3m4.py: using CellId 38941 06:09:49.127939 tst iperf3m4.py: using BVCI 38942 06:09:49.251557 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.263282 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.274697 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.286140 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.297820 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.309331 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.321090 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.332487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:49.344265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:49.466546 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:49.586771 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:49.704373 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:49.826777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:09:50.057706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:50.398491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16153): Launched 06:09:50.695520 run iperf3-srv_10.42.42.10(pid=16154): Launched 06:09:50.822056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:09:51.050958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:51.390967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16155): Launched 06:09:51.686209 run iperf3-srv_10.42.42.10(pid=16156): Launched 06:09:51.812873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:09:52.042231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:52.381988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16157): Launched 06:09:52.676565 run iperf3-srv_10.42.42.10(pid=16158): Launched 06:09:52.803073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:09:53.031943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:53.371646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16159): Launched 06:09:53.669101 run iperf3-srv_10.42.42.10(pid=16160): Launched 06:09:53.795100 tst iperf3m4.py:8: start network... 06:09:54.024203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:54.547485 run create_hlr_db(pid=16161): Launched 06:09:54.683714 bus /gobi_6: Setting Powered False 06:09:55.749114 run create_hlr_db(pid=16161): Terminated: ok {rc=0} 06:09:56.218034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16163): Launched 06:09:56.555734 run osmo-hlr_10.42.42.2(pid=16164): Launched 06:09:56.683844 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:57.265373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16166): Launched 06:09:57.603864 run osmo-stp_10.42.42.5(pid=16167): Launched 06:09:57.731591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:58.315713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16169): Launched 06:09:58.444676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:58.730974 run patchelf(pid=16170): Launched 06:09:58.918057 run osmo-stp_10.42.42.5(pid=16167): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16167)] 06:09:59.061042 run osmo-stp_10.42.42.5(pid=16167): stdout: | (launched: 2022-12-14_06:09:57.541451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:59.205466 run osmo-stp_10.42.42.5(pid=16167): stderr: | 20221214060957735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060957735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060957735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060957736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060957736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060957736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060957736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:59.349719 run osmo-stp_10.42.42.5(pid=16167): stdout: | (launched: 2022-12-14_06:09:57.541451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:59.487511 run osmo-stp_10.42.42.5(pid=16167): stderr: | 20221214060957735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214060957735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214060957735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214060957736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214060957736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214060957736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214060957736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:59.650954 run patchelf(pid=16170): Terminating (SIGINT) 06:09:59.838962 run patchelf(pid=16170): Terminated: ok {rc=0} 06:09:59.975621 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16167): Process ended prematurely: osmo-stp_10.42.42.5(pid=16167) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16167)] [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 06:09:59.985965 tst iperf3m4.py:8: Test FAILED (11.4 sec) 06:10:00.014933 run osmo-hlr_10.42.42.2(pid=16164): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16164)] 06:10:00.065478 run osmo-hlr_10.42.42.2(pid=16164): stdout: | (launched: 2022-12-14_06:09:56.493880) 06:10:00.117674 run osmo-hlr_10.42.42.2(pid=16164): stderr: | 20221214060956694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214060956694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214060956694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214060956694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214060956694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214060956694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214060956710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214060956719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214060956719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214060956720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:00.170082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16153): Terminating (SIGTERM) 06:10:00.212293 run iperf3-srv_10.42.42.10(pid=16154): Terminating (SIGTERM) 06:10:00.254835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16155): Terminating (SIGTERM) 06:10:00.297355 run iperf3-srv_10.42.42.10(pid=16156): Terminating (SIGTERM) 06:10:00.339608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16157): Terminating (SIGTERM) 06:10:00.382434 run iperf3-srv_10.42.42.10(pid=16158): Terminating (SIGTERM) 06:10:00.424445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16159): Terminating (SIGTERM) 06:10:00.466660 run iperf3-srv_10.42.42.10(pid=16160): Terminating (SIGTERM) 06:10:00.508683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16163): Terminating (SIGTERM) 06:10:00.551053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16166): Terminating (SIGTERM) 06:10:00.593290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16169): Terminating (SIGTERM) 06:10:00.635710 --- ParallelTerminationStrategy: PID 16153 died... 06:10:00.656216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16153): Terminated: ok {rc=0} 06:10:00.702803 --- ParallelTerminationStrategy: PID 16154 died... 06:10:00.722693 run iperf3-srv_10.42.42.10(pid=16154): Terminated {rc=256} 06:10:00.769219 --- ParallelTerminationStrategy: PID 16155 died... 06:10:00.789000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16155): Terminated: ok {rc=0} 06:10:00.835494 --- ParallelTerminationStrategy: PID 16156 died... 06:10:00.855489 run iperf3-srv_10.42.42.10(pid=16156): Terminated {rc=256} 06:10:00.902264 --- ParallelTerminationStrategy: PID 16157 died... 06:10:00.922679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16157): Terminated: ok {rc=0} 06:10:00.969872 --- ParallelTerminationStrategy: PID 16158 died... 06:10:00.990245 run iperf3-srv_10.42.42.10(pid=16158): Terminated {rc=256} 06:10:01.044418 --- ParallelTerminationStrategy: PID 16159 died... 06:10:01.069177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16159): Terminated: ok {rc=0} 06:10:01.119167 --- ParallelTerminationStrategy: PID 16160 died... 06:10:01.139853 run iperf3-srv_10.42.42.10(pid=16160): Terminated {rc=256} 06:10:01.187176 --- ParallelTerminationStrategy: PID 16163 died... 06:10:01.207803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16163): Terminated: ok {rc=0} 06:10:01.255327 --- ParallelTerminationStrategy: PID 16166 died... 06:10:01.275938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16166): Terminated: ok {rc=0} 06:10:01.323373 --- ParallelTerminationStrategy: PID 16169 died... 06:10:01.343955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16169): Terminated: ok {rc=0} 06:10:01.434095 bus /gobi_4: Setting Powered False 06:10:02.531104 bus /gobi_4: Setting Powered False 06:10:03.647493 bus /gobi_1: Setting Powered False 06:10:04.748149 bus /gobi_1: Setting Powered False 06:10:05.861085 bus /gobi_0: Setting Powered False 06:10:06.956867 bus /gobi_0: Setting Powered False 06:10:08.070388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 06:10:09.173619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.185854 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:10:09.237500 tst ping.py: using LAC 38942 06:10:09.368595 tst ping.py: using RAC 182 06:10:09.497395 tst ping.py: using CellId 38942 06:10:09.626880 tst ping.py: using BVCI 38943 06:10:09.746936 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.758566 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.769988 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.781323 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.792477 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.803782 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.815232 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:09.826547 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:10:09.945973 tst ping.py:19: start network... 06:10:10.170694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:10.683638 run create_hlr_db(pid=16174): Launched 06:10:10.817057 bus /gobi_6: Setting Powered False 06:10:11.882455 run create_hlr_db(pid=16174): Terminated: ok {rc=0} 06:10:12.326101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16176): Launched 06:10:12.638424 run osmo-hlr_10.42.42.2(pid=16177): Launched 06:10:12.757911 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:13.295160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16179): Launched 06:10:13.605728 run osmo-stp_10.42.42.5(pid=16180): Launched 06:10:13.725188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:14.262376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16182): Launched 06:10:14.381459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:14.645150 run patchelf(pid=16183): Launched 06:10:14.818462 run osmo-stp_10.42.42.5(pid=16180): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16180)] 06:10:14.950306 run osmo-stp_10.42.42.5(pid=16180): stdout: | (launched: 2022-12-14_06:10:13.548154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:15.083721 run osmo-stp_10.42.42.5(pid=16180): stderr: | 20221214061013719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061013719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061013719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061013720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061013720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061013720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061013720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:15.217380 run osmo-stp_10.42.42.5(pid=16180): stdout: | (launched: 2022-12-14_06:10:13.548154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:15.344419 run osmo-stp_10.42.42.5(pid=16180): stderr: | 20221214061013719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061013719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061013719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061013720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061013720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061013720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061013720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:15.495172 run patchelf(pid=16183): Terminating (SIGINT) 06:10:15.668676 run patchelf(pid=16183): Terminated: ok {rc=0} 06:10:15.793623 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16180): Process ended prematurely: osmo-stp_10.42.42.5(pid=16180) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16180)] [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 06:10:15.802629 tst ping.py:22: Test FAILED (6.6 sec) 06:10:15.834463 run osmo-hlr_10.42.42.2(pid=16177): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16177)] 06:10:15.889924 run osmo-hlr_10.42.42.2(pid=16177): stdout: | (launched: 2022-12-14_06:10:12.580315) 06:10:15.945121 run osmo-hlr_10.42.42.2(pid=16177): stderr: | 20221214061012758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061012758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061012758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061012758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061012758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061012758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061012770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061012778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061012779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061012779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:15.998827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16176): Terminating (SIGTERM) 06:10:16.043187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16179): Terminating (SIGTERM) 06:10:16.090320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16182): Terminating (SIGTERM) 06:10:16.136329 --- ParallelTerminationStrategy: PID 16176 died... 06:10:16.157332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16176): Terminated: ok {rc=0} 06:10:16.206525 --- ParallelTerminationStrategy: PID 16179 died... 06:10:16.227203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16179): Terminated: ok {rc=0} 06:10:16.275883 --- ParallelTerminationStrategy: PID 16182 died... 06:10:16.296419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16182): Terminated: ok {rc=0} 06:10:16.386554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:10:17.475573 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:17.487929 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:10:17.540769 tst ping_idle_ping.py: using LAC 38943 06:10:17.672617 tst ping_idle_ping.py: using RAC 183 06:10:17.805958 tst ping_idle_ping.py: using CellId 38943 06:10:17.936254 tst ping_idle_ping.py: using BVCI 38944 06:10:18.059994 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.071788 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.083410 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.095079 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.107002 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.118439 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.130803 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:10:18.142798 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:10:18.263147 tst ping_idle_ping.py:24: start network... 06:10:18.474201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:18.959657 run create_hlr_db(pid=16184): Launched 06:10:19.078555 bus /gobi_6: Setting Powered False 06:10:20.139878 run create_hlr_db(pid=16184): Terminated: ok {rc=0} 06:10:20.596535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16186): Launched 06:10:20.929766 run osmo-hlr_10.42.42.2(pid=16187): Launched 06:10:21.057668 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:21.630603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16189): Launched 06:10:21.963033 run osmo-stp_10.42.42.5(pid=16190): Launched 06:10:22.090352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:22.664487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16192): Launched 06:10:22.791509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:23.073437 run patchelf(pid=16193): Launched 06:10:23.257915 run osmo-stp_10.42.42.5(pid=16190): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16190)] 06:10:23.398283 run osmo-stp_10.42.42.5(pid=16190): stdout: | (launched: 2022-12-14_06:10:21.901962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:23.540346 run osmo-stp_10.42.42.5(pid=16190): stderr: | 20221214061022097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061022097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061022097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061022098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061022098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061022098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061022098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:23.682126 run osmo-stp_10.42.42.5(pid=16190): stdout: | (launched: 2022-12-14_06:10:21.901962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:23.817775 run osmo-stp_10.42.42.5(pid=16190): stderr: | 20221214061022097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061022097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061022097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061022098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061022098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061022098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061022098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:23.978390 run patchelf(pid=16193): Terminating (SIGINT) 06:10:24.164111 run patchelf(pid=16193): Terminated: ok {rc=0} 06:10:24.297611 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16190): Process ended prematurely: osmo-stp_10.42.42.5(pid=16190) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16190)] [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 06:10:24.307320 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:10:24.335826 run osmo-hlr_10.42.42.2(pid=16187): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16187)] 06:10:24.386224 run osmo-hlr_10.42.42.2(pid=16187): stdout: | (launched: 2022-12-14_06:10:20.868580) 06:10:24.438535 run osmo-hlr_10.42.42.2(pid=16187): stderr: | 20221214061021067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061021067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061021067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061021067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061021067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061021067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061021082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061021092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061021092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061021092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:24.491493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16186): Terminating (SIGTERM) 06:10:24.533961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16189): Terminating (SIGTERM) 06:10:24.576416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16192): Terminating (SIGTERM) 06:10:24.620231 --- ParallelTerminationStrategy: PID 16186 died... 06:10:24.640843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16186): Terminated: ok {rc=0} 06:10:24.687704 --- ParallelTerminationStrategy: PID 16189 died... 06:10:24.707770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16189): Terminated: ok {rc=0} 06:10:24.754503 --- ParallelTerminationStrategy: PID 16192 died... 06:10:24.774563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16192): Terminated: ok {rc=0} 06:10:24.862910 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:10:26.173724 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:10:26.181723 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:10:26.214403 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:10:26.253252 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:10:26.339273 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:10:26.371530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:10:26.410090 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:10:27.002867 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:10:27.054819 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.065734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:27.134257 tst cs_paging_gprs_active.py: using LAC 38944 06:10:27.258641 tst cs_paging_gprs_active.py: using RAC 184 06:10:27.383932 tst cs_paging_gprs_active.py: using CellId 38944 06:10:27.509411 tst cs_paging_gprs_active.py: using BVCI 38945 06:10:27.626253 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.637221 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.648004 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.658778 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.669929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.681064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.692169 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.703258 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:27.714577 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:27.837731 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:27.957890 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:10:28.172390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:28.491063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16198): Launched 06:10:28.767744 run iperf3-srv_10.42.42.10(pid=16199): Launched 06:10:28.887002 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:10:29.099829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:29.418264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16200): Launched 06:10:29.694080 run iperf3-srv_10.42.42.10(pid=16201): Launched 06:10:29.812526 tst cs_paging_gprs_active.py:38: start network... 06:10:30.025094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:30.515108 run create_hlr_db(pid=16202): Launched 06:10:30.636058 bus /gobi_6: Setting Powered False 06:10:31.698631 run create_hlr_db(pid=16202): Terminated: ok {rc=0} 06:10:32.158050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16204): Launched 06:10:32.488633 run osmo-hlr_10.42.42.2(pid=16205): Launched 06:10:32.610798 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:33.168266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16207): Launched 06:10:33.485896 run osmo-stp_10.42.42.5(pid=16208): Launched 06:10:33.606668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:34.154636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16210): Launched 06:10:34.276664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:34.551508 run patchelf(pid=16211): Launched 06:10:34.727659 run osmo-stp_10.42.42.5(pid=16208): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16208)] 06:10:34.861435 run osmo-stp_10.42.42.5(pid=16208): stdout: | (launched: 2022-12-14_06:10:33.426951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:34.996751 run osmo-stp_10.42.42.5(pid=16208): stderr: | 20221214061033600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061033600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061033600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061033600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061033601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061033601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061033601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:35.132579 run osmo-stp_10.42.42.5(pid=16208): stdout: | (launched: 2022-12-14_06:10:33.426951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:35.262365 run osmo-stp_10.42.42.5(pid=16208): stderr: | 20221214061033600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061033600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061033600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061033600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061033601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061033601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061033601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:35.415171 run patchelf(pid=16211): Terminating (SIGINT) 06:10:35.592160 run patchelf(pid=16211): Terminated: ok {rc=0} 06:10:35.720135 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16208): Process ended prematurely: osmo-stp_10.42.42.5(pid=16208) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16208)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:10:35.729943 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 06:10:35.757334 run osmo-hlr_10.42.42.2(pid=16205): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16205)] 06:10:35.805419 run osmo-hlr_10.42.42.2(pid=16205): stdout: | (launched: 2022-12-14_06:10:32.429754) 06:10:35.855211 run osmo-hlr_10.42.42.2(pid=16205): stderr: | 20221214061032608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061032608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061032608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061032608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061032608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061032608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061032619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061032627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061032627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061032627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:35.905263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16198): Terminating (SIGTERM) 06:10:35.945400 run iperf3-srv_10.42.42.10(pid=16199): Terminating (SIGTERM) 06:10:35.985239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16200): Terminating (SIGTERM) 06:10:36.025067 run iperf3-srv_10.42.42.10(pid=16201): Terminating (SIGTERM) 06:10:36.064831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16204): Terminating (SIGTERM) 06:10:36.104592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16207): Terminating (SIGTERM) 06:10:36.144655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16210): Terminating (SIGTERM) 06:10:36.184828 --- ParallelTerminationStrategy: PID 16198 died... 06:10:36.204275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16198): Terminated: ok {rc=0} 06:10:36.248373 --- ParallelTerminationStrategy: PID 16199 died... 06:10:36.267397 run iperf3-srv_10.42.42.10(pid=16199): Terminated {rc=256} 06:10:36.311494 --- ParallelTerminationStrategy: PID 16200 died... 06:10:36.330530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16200): Terminated: ok {rc=0} 06:10:36.374593 --- ParallelTerminationStrategy: PID 16201 died... 06:10:36.393569 run iperf3-srv_10.42.42.10(pid=16201): Terminated {rc=256} 06:10:36.437780 --- ParallelTerminationStrategy: PID 16204 died... 06:10:36.456647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16204): Terminated: ok {rc=0} 06:10:36.501256 --- ParallelTerminationStrategy: PID 16207 died... 06:10:36.520166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16207): Terminated: ok {rc=0} 06:10:36.564425 --- ParallelTerminationStrategy: PID 16210 died... 06:10:36.583515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16210): Terminated: ok {rc=0} 06:10:36.669572 bus /gobi_0: Setting Powered False 06:10:37.769264 bus /gobi_0: Setting Powered False 06:10:38.884788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:10:40.033725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.045297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:40.114579 tst iperf3.py: using LAC 38945 06:10:40.239290 tst iperf3.py: using RAC 185 06:10:40.364609 tst iperf3.py: using CellId 38945 06:10:40.489218 tst iperf3.py: using BVCI 38946 06:10:40.603685 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.614755 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.625690 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.636420 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.647512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.658681 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.669918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.680881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:40.692155 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:40.807322 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:10:41.020512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:41.338419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16212): Launched 06:10:41.614500 run iperf3-srv_10.42.42.10(pid=16213): Launched 06:10:41.732340 tst iperf3.py:8: start network... 06:10:41.944673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:42.434836 run create_hlr_db(pid=16214): Launched 06:10:42.553882 bus /gobi_6: Setting Powered False 06:10:43.620429 run create_hlr_db(pid=16214): Terminated: ok {rc=0} 06:10:44.086797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16216): Launched 06:10:44.426469 run osmo-hlr_10.42.42.2(pid=16217): Launched 06:10:44.554701 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:45.232470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16219): Launched 06:10:45.561598 run osmo-stp_10.42.42.5(pid=16220): Launched 06:10:45.686150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:46.301337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16222): Launched 06:10:46.439629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:46.726780 run patchelf(pid=16223): Launched 06:10:46.919864 run osmo-stp_10.42.42.5(pid=16220): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16220)] 06:10:47.055874 run osmo-stp_10.42.42.5(pid=16220): stdout: | (launched: 2022-12-14_06:10:45.500876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:47.194296 run osmo-stp_10.42.42.5(pid=16220): stderr: | 20221214061045695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061045695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061045696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061045696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061045698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061045698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061045698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:47.328643 run osmo-stp_10.42.42.5(pid=16220): stdout: | (launched: 2022-12-14_06:10:45.500876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:47.456069 run osmo-stp_10.42.42.5(pid=16220): stderr: | 20221214061045695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061045695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061045696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061045696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061045698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061045698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061045698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:47.606892 run patchelf(pid=16223): Terminating (SIGINT) 06:10:47.781162 run patchelf(pid=16223): Terminated: ok {rc=0} 06:10:47.907137 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16220): Process ended prematurely: osmo-stp_10.42.42.5(pid=16220) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16220)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 06:10:47.916814 tst iperf3.py:8: Test FAILED (7.9 sec) 06:10:47.944506 run osmo-hlr_10.42.42.2(pid=16217): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16217)] 06:10:47.993075 run osmo-hlr_10.42.42.2(pid=16217): stdout: | (launched: 2022-12-14_06:10:44.364739) 06:10:48.042948 run osmo-hlr_10.42.42.2(pid=16217): stderr: | 20221214061044567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061044568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061044568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061044568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061044568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061044568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061044581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061044590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061044590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061044590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:48.093387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16212): Terminating (SIGTERM) 06:10:48.133815 run iperf3-srv_10.42.42.10(pid=16213): Terminating (SIGTERM) 06:10:48.173969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16216): Terminating (SIGTERM) 06:10:48.214428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16219): Terminating (SIGTERM) 06:10:48.255060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16222): Terminating (SIGTERM) 06:10:48.295643 --- ParallelTerminationStrategy: PID 16212 died... 06:10:48.315129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16212): Terminated: ok {rc=0} 06:10:48.359882 --- ParallelTerminationStrategy: PID 16213 died... 06:10:48.379074 run iperf3-srv_10.42.42.10(pid=16213): Terminated {rc=256} 06:10:48.423695 --- ParallelTerminationStrategy: PID 16216 died... 06:10:48.443014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16216): Terminated: ok {rc=0} 06:10:48.487634 --- ParallelTerminationStrategy: PID 16219 died... 06:10:48.506718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16219): Terminated: ok {rc=0} 06:10:48.551331 --- ParallelTerminationStrategy: PID 16222 died... 06:10:48.570514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16222): Terminated: ok {rc=0} 06:10:48.656004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:10:49.808029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:49.820206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:49.893551 tst iperf3m4.py: using LAC 38946 06:10:50.014167 tst iperf3m4.py: using RAC 186 06:10:50.136384 tst iperf3m4.py: using CellId 38946 06:10:50.255118 tst iperf3m4.py: using BVCI 38947 06:10:50.367667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.378689 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.389555 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.400160 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.411177 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.422117 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.433162 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.444010 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:50.455055 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:50.575284 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:50.698308 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:50.816527 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:50.938648 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:10:51.162454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:51.494743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16224): Launched 06:10:51.782589 run iperf3-srv_10.42.42.10(pid=16225): Launched 06:10:51.906232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:10:52.123136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:52.435732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16229): Launched 06:10:52.706071 run iperf3-srv_10.42.42.10(pid=16230): Launched 06:10:52.822200 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:10:53.030109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:53.342579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16231): Launched 06:10:53.612826 run iperf3-srv_10.42.42.10(pid=16232): Launched 06:10:53.729093 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:10:53.936698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:54.249627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16233): Launched 06:10:54.519863 run iperf3-srv_10.42.42.10(pid=16234): Launched 06:10:54.635548 tst iperf3m4.py:8: start network... 06:10:54.843560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:55.327658 run create_hlr_db(pid=16235): Launched 06:10:55.445341 bus /gobi_6: Setting Powered False 06:10:56.507327 run create_hlr_db(pid=16235): Terminated: ok {rc=0} 06:10:56.960241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16237): Launched 06:10:57.292936 run osmo-hlr_10.42.42.2(pid=16238): Launched 06:10:57.419080 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:57.992170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16240): Launched 06:10:58.323013 run osmo-stp_10.42.42.5(pid=16241): Launched 06:10:58.448196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:59.019471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16243): Launched 06:10:59.146712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:59.426921 run patchelf(pid=16244): Launched 06:10:59.609594 run osmo-stp_10.42.42.5(pid=16241): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16241)] 06:10:59.749307 run osmo-stp_10.42.42.5(pid=16241): stdout: | (launched: 2022-12-14_06:10:58.262315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:59.890672 run osmo-stp_10.42.42.5(pid=16241): stderr: | 20221214061058453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061058453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061058453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061058453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061058454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061058454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061058454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:00.032617 run osmo-stp_10.42.42.5(pid=16241): stdout: | (launched: 2022-12-14_06:10:58.262315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:00.167993 run osmo-stp_10.42.42.5(pid=16241): stderr: | 20221214061058453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061058453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061058453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061058453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061058454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061058454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061058454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:00.328451 run patchelf(pid=16244): Terminating (SIGINT) 06:11:00.513192 run patchelf(pid=16244): Terminated: ok {rc=0} 06:11:00.646367 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16241): Process ended prematurely: osmo-stp_10.42.42.5(pid=16241) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16241)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:11:00.656814 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:11:00.685696 run osmo-hlr_10.42.42.2(pid=16238): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16238)] 06:11:00.736184 run osmo-hlr_10.42.42.2(pid=16238): stdout: | (launched: 2022-12-14_06:10:57.232093) 06:11:00.788323 run osmo-hlr_10.42.42.2(pid=16238): stderr: | 20221214061057430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061057430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061057430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061057430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061057430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061057430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061057442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061057451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061057451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061057451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:00.846258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16224): Terminating (SIGTERM) 06:11:00.895165 run iperf3-srv_10.42.42.10(pid=16225): Terminating (SIGTERM) 06:11:00.955010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16229): Terminating (SIGTERM) 06:11:01.000010 run iperf3-srv_10.42.42.10(pid=16230): Terminating (SIGTERM) 06:11:01.050031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16231): Terminating (SIGTERM) 06:11:01.095059 run iperf3-srv_10.42.42.10(pid=16232): Terminating (SIGTERM) 06:11:01.141971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16233): Terminating (SIGTERM) 06:11:01.186055 run iperf3-srv_10.42.42.10(pid=16234): Terminating (SIGTERM) 06:11:01.229410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16237): Terminating (SIGTERM) 06:11:01.274283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16240): Terminating (SIGTERM) 06:11:01.319498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16243): Terminating (SIGTERM) 06:11:01.364309 --- ParallelTerminationStrategy: PID 16224 died... 06:11:01.386070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16224): Terminated: ok {rc=0} 06:11:01.435397 --- ParallelTerminationStrategy: PID 16225 died... 06:11:01.456499 run iperf3-srv_10.42.42.10(pid=16225): Terminated {rc=256} 06:11:01.505871 --- ParallelTerminationStrategy: PID 16229 died... 06:11:01.527470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16229): Terminated: ok {rc=0} 06:11:01.576024 --- ParallelTerminationStrategy: PID 16230 died... 06:11:01.597541 run iperf3-srv_10.42.42.10(pid=16230): Terminated {rc=256} 06:11:01.645652 --- ParallelTerminationStrategy: PID 16231 died... 06:11:01.667908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16231): Terminated: ok {rc=0} 06:11:01.717305 --- ParallelTerminationStrategy: PID 16232 died... 06:11:01.738708 run iperf3-srv_10.42.42.10(pid=16232): Terminated {rc=256} 06:11:01.787649 --- ParallelTerminationStrategy: PID 16233 died... 06:11:01.809335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16233): Terminated: ok {rc=0} 06:11:01.858294 --- ParallelTerminationStrategy: PID 16234 died... 06:11:01.880216 run iperf3-srv_10.42.42.10(pid=16234): Terminated {rc=256} 06:11:01.929460 --- ParallelTerminationStrategy: PID 16237 died... 06:11:01.950720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16237): Terminated: ok {rc=0} 06:11:01.998227 --- ParallelTerminationStrategy: PID 16240 died... 06:11:02.019596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16240): Terminated: ok {rc=0} 06:11:02.067280 --- ParallelTerminationStrategy: PID 16243 died... 06:11:02.089684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16243): Terminated: ok {rc=0} 06:11:02.186488 bus /gobi_4: Setting Powered False 06:11:03.287255 bus /gobi_4: Setting Powered False 06:11:04.405080 bus /gobi_1: Setting Powered False 06:11:05.505629 bus /gobi_1: Setting Powered False 06:11:06.623370 bus /gobi_0: Setting Powered False 06:11:07.720403 bus /gobi_0: Setting Powered False 06:11:08.836497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:11:09.940012 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:09.952095 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:11:10.023853 tst ping.py: using LAC 38947 06:11:10.153518 tst ping.py: using RAC 187 06:11:10.273927 tst ping.py: using CellId 38947 06:11:10.403094 tst ping.py: using BVCI 38948 06:11:10.522346 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.533827 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.545002 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.556315 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.567465 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.578808 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.590575 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:10.601929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:11:10.721483 tst ping.py:19: start network... 06:11:10.941848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:11.448940 run create_hlr_db(pid=16245): Launched 06:11:11.580059 bus /gobi_6: Setting Powered False 06:11:12.645243 run create_hlr_db(pid=16245): Terminated: ok {rc=0} 06:11:13.083577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16247): Launched 06:11:13.390765 run osmo-hlr_10.42.42.2(pid=16248): Launched 06:11:13.508024 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:14.047524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16250): Launched 06:11:14.353882 run osmo-stp_10.42.42.5(pid=16251): Launched 06:11:14.471205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:15.001576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16253): Launched 06:11:15.118878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:15.378513 run patchelf(pid=16254): Launched 06:11:15.548189 run osmo-stp_10.42.42.5(pid=16251): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16251)] 06:11:15.677744 run osmo-stp_10.42.42.5(pid=16251): stdout: | (launched: 2022-12-14_06:11:14.297138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:15.809357 run osmo-stp_10.42.42.5(pid=16251): stderr: | 20221214061114469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061114469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061114469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061114470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061114470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061114470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061114470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:15.973551 run osmo-stp_10.42.42.5(pid=16251): stdout: | (launched: 2022-12-14_06:11:14.297138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:16.114281 run osmo-stp_10.42.42.5(pid=16251): stderr: | 20221214061114469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061114469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061114469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061114470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061114470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061114470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061114470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:16.278932 run patchelf(pid=16254): Terminating (SIGINT) 06:11:16.466479 run patchelf(pid=16254): Terminated: ok {rc=0} 06:11:16.604355 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16251): Process ended prematurely: osmo-stp_10.42.42.5(pid=16251) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16251)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 06:11:16.615543 tst ping.py:22: Test FAILED (6.7 sec) 06:11:16.645873 run osmo-hlr_10.42.42.2(pid=16248): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16248)] 06:11:16.701315 run osmo-hlr_10.42.42.2(pid=16248): stdout: | (launched: 2022-12-14_06:11:13.334175) 06:11:16.757147 run osmo-hlr_10.42.42.2(pid=16248): stderr: | 20221214061113513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061113513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061113513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061113513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061113513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061113513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061113536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061113545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061113545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061113545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:16.812336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16247): Terminating (SIGTERM) 06:11:16.857092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16250): Terminating (SIGTERM) 06:11:16.905902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16253): Terminating (SIGTERM) 06:11:16.952569 --- ParallelTerminationStrategy: PID 16247 died... 06:11:16.974528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16247): Terminated: ok {rc=0} 06:11:17.024431 --- ParallelTerminationStrategy: PID 16250 died... 06:11:17.045390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16250): Terminated: ok {rc=0} 06:11:17.094654 --- ParallelTerminationStrategy: PID 16253 died... 06:11:17.115944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16253): Terminated: ok {rc=0} 06:11:17.206589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:11:18.295917 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.308128 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:11:18.384474 tst ping_idle_ping.py: using LAC 38948 06:11:18.515412 tst ping_idle_ping.py: using RAC 188 06:11:18.643859 tst ping_idle_ping.py: using CellId 38948 06:11:18.777148 tst ping_idle_ping.py: using BVCI 38949 06:11:18.897255 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.908832 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.920251 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.931512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.943391 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.955329 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.967264 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:11:18.979144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:11:19.098700 tst ping_idle_ping.py:24: start network... 06:11:19.306052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:19.781953 run create_hlr_db(pid=16255): Launched 06:11:19.899189 bus /gobi_6: Setting Powered False 06:11:20.959815 run create_hlr_db(pid=16255): Terminated: ok {rc=0} 06:11:21.407160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16257): Launched 06:11:21.733478 run osmo-hlr_10.42.42.2(pid=16258): Launched 06:11:21.858067 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:22.419741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16260): Launched 06:11:22.748231 run osmo-stp_10.42.42.5(pid=16261): Launched 06:11:22.872551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:23.438654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16263): Launched 06:11:23.563906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:23.841438 run patchelf(pid=16264): Launched 06:11:24.022737 run osmo-stp_10.42.42.5(pid=16261): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16261)] 06:11:24.161154 run osmo-stp_10.42.42.5(pid=16261): stdout: | (launched: 2022-12-14_06:11:22.688005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:24.300670 run osmo-stp_10.42.42.5(pid=16261): stderr: | 20221214061122885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061122885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061122885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061122886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061122886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061122886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061122886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:24.440456 run osmo-stp_10.42.42.5(pid=16261): stdout: | (launched: 2022-12-14_06:11:22.688005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:24.574634 run osmo-stp_10.42.42.5(pid=16261): stderr: | 20221214061122885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061122885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061122885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061122886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061122886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061122886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061122886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:24.732426 run patchelf(pid=16264): Terminating (SIGINT) 06:11:24.915180 run patchelf(pid=16264): Terminated: ok {rc=0} 06:11:25.047041 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16261): Process ended prematurely: osmo-stp_10.42.42.5(pid=16261) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16261)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:11:25.056669 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:11:25.085311 run osmo-hlr_10.42.42.2(pid=16258): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16258)] 06:11:25.135818 run osmo-hlr_10.42.42.2(pid=16258): stdout: | (launched: 2022-12-14_06:11:21.673687) 06:11:25.187839 run osmo-hlr_10.42.42.2(pid=16258): stderr: | 20221214061121871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061121871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061121871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061121871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061121871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061121871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061121885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061121893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061121894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061121894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:25.240137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16257): Terminating (SIGTERM) 06:11:25.282258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16260): Terminating (SIGTERM) 06:11:25.324770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16263): Terminating (SIGTERM) 06:11:25.366938 --- ParallelTerminationStrategy: PID 16257 died... 06:11:25.387110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16257): Terminated: ok {rc=0} 06:11:25.433795 --- ParallelTerminationStrategy: PID 16260 died... 06:11:25.453409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16260): Terminated: ok {rc=0} 06:11:25.500040 --- ParallelTerminationStrategy: PID 16263 died... 06:11:25.520012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16263): Terminated: ok {rc=0} 06:11:25.609298 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:11:26.921795 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:11:26.928422 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:11:26.961600 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:11:27.002206 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:11:27.090982 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:11:27.124453 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:11:27.164705 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:11:27.761126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:11:27.815200 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:27.826838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:27.901239 tst cs_paging_gprs_active.py: using LAC 38949 06:11:28.030532 tst cs_paging_gprs_active.py: using RAC 189 06:11:28.159369 tst cs_paging_gprs_active.py: using CellId 38949 06:11:28.286846 tst cs_paging_gprs_active.py: using BVCI 38950 06:11:28.407166 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.418647 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.429863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.441171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.452285 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.463512 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.474843 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.486091 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:28.497473 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:28.617403 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:28.743551 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:11:28.969075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:29.304639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16268): Launched 06:11:29.594828 run iperf3-srv_10.42.42.10(pid=16269): Launched 06:11:29.719884 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:11:29.944766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:30.281165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16270): Launched 06:11:30.571123 run iperf3-srv_10.42.42.10(pid=16271): Launched 06:11:30.695804 tst cs_paging_gprs_active.py:38: start network... 06:11:30.922849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:31.453020 run create_hlr_db(pid=16272): Launched 06:11:31.622438 bus /gobi_6: Setting Powered False 06:11:32.689182 run create_hlr_db(pid=16272): Terminated: ok {rc=0} 06:11:33.135081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16274): Launched 06:11:33.448888 run osmo-hlr_10.42.42.2(pid=16275): Launched 06:11:33.569675 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:34.122501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16277): Launched 06:11:34.434420 run osmo-stp_10.42.42.5(pid=16278): Launched 06:11:34.553273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:35.091623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16280): Launched 06:11:35.212048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:35.479320 run patchelf(pid=16281): Launched 06:11:35.652777 run osmo-stp_10.42.42.5(pid=16278): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16278)] 06:11:35.785238 run osmo-stp_10.42.42.5(pid=16278): stdout: | (launched: 2022-12-14_06:11:34.376716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:35.919158 run osmo-stp_10.42.42.5(pid=16278): stderr: | 20221214061134549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061134549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061134549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061134550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061134552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061134552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061134552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:36.053676 run osmo-stp_10.42.42.5(pid=16278): stdout: | (launched: 2022-12-14_06:11:34.376716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:36.181508 run osmo-stp_10.42.42.5(pid=16278): stderr: | 20221214061134549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061134549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061134549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061134550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061134552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061134552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061134552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:36.332767 run patchelf(pid=16281): Terminating (SIGINT) 06:11:36.507944 run patchelf(pid=16281): Terminated: ok {rc=0} 06:11:36.635006 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16278): Process ended prematurely: osmo-stp_10.42.42.5(pid=16278) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16278)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:11:36.644603 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:11:36.671970 run osmo-hlr_10.42.42.2(pid=16275): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16275)] 06:11:36.720405 run osmo-hlr_10.42.42.2(pid=16275): stdout: | (launched: 2022-12-14_06:11:33.391125) 06:11:36.770589 run osmo-hlr_10.42.42.2(pid=16275): stderr: | 20221214061133566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061133566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061133566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061133566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061133566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061133566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061133579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061133589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061133589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061133589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:36.820942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16268): Terminating (SIGTERM) 06:11:36.861337 run iperf3-srv_10.42.42.10(pid=16269): Terminating (SIGTERM) 06:11:36.901386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16270): Terminating (SIGTERM) 06:11:36.941600 run iperf3-srv_10.42.42.10(pid=16271): Terminating (SIGTERM) 06:11:36.981770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16274): Terminating (SIGTERM) 06:11:37.022031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16277): Terminating (SIGTERM) 06:11:37.062320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16280): Terminating (SIGTERM) 06:11:37.102822 --- ParallelTerminationStrategy: PID 16268 died... 06:11:37.122708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16268): Terminated: ok {rc=0} 06:11:37.167362 --- ParallelTerminationStrategy: PID 16269 died... 06:11:37.186528 run iperf3-srv_10.42.42.10(pid=16269): Terminated {rc=256} 06:11:37.230983 --- ParallelTerminationStrategy: PID 16270 died... 06:11:37.250078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16270): Terminated: ok {rc=0} 06:11:37.294438 --- ParallelTerminationStrategy: PID 16271 died... 06:11:37.313354 run iperf3-srv_10.42.42.10(pid=16271): Terminated {rc=256} 06:11:37.357773 --- ParallelTerminationStrategy: PID 16274 died... 06:11:37.376992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16274): Terminated: ok {rc=0} 06:11:37.421289 --- ParallelTerminationStrategy: PID 16277 died... 06:11:37.440431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16277): Terminated: ok {rc=0} 06:11:37.484824 --- ParallelTerminationStrategy: PID 16280 died... 06:11:37.504565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16280): Terminated: ok {rc=0} 06:11:37.591627 bus /gobi_0: Setting Powered False 06:11:38.690925 bus /gobi_0: Setting Powered False 06:11:39.806143 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:11:40.956135 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:40.968441 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:41.040405 tst iperf3.py: using LAC 38950 06:11:41.162574 tst iperf3.py: using RAC 190 06:11:41.290675 tst iperf3.py: using CellId 38950 06:11:41.412535 tst iperf3.py: using BVCI 38951 06:11:41.525341 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.536414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.547364 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.558376 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.569617 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.581143 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.592295 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.603220 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:41.614604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:41.734758 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:11:41.959156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:42.293076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16282): Launched 06:11:42.581482 run iperf3-srv_10.42.42.10(pid=16283): Launched 06:11:42.706262 tst iperf3.py:8: start network... 06:11:42.929578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:43.443682 run create_hlr_db(pid=16284): Launched 06:11:43.578248 bus /gobi_6: Setting Powered False 06:11:44.643590 run create_hlr_db(pid=16284): Terminated: ok {rc=0} 06:11:45.106096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16286): Launched 06:11:45.438098 run osmo-hlr_10.42.42.2(pid=16287): Launched 06:11:45.563404 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:46.149755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16289): Launched 06:11:46.541139 run osmo-stp_10.42.42.5(pid=16290): Launched 06:11:46.883039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:47.506939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16292): Launched 06:11:47.627101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:47.892633 run patchelf(pid=16293): Launched 06:11:48.066628 run osmo-stp_10.42.42.5(pid=16290): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16290)] 06:11:48.199184 run osmo-stp_10.42.42.5(pid=16290): stdout: | (launched: 2022-12-14_06:11:46.458709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:48.333141 run osmo-stp_10.42.42.5(pid=16290): stderr: | 20221214061146723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061146723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061146723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061146724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061146724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061146724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061146724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:48.467052 run osmo-stp_10.42.42.5(pid=16290): stdout: | (launched: 2022-12-14_06:11:46.458709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:48.594664 run osmo-stp_10.42.42.5(pid=16290): stderr: | 20221214061146723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061146723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061146723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061146724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061146724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061146724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061146724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:48.746580 run patchelf(pid=16293): Terminating (SIGINT) 06:11:48.922406 run patchelf(pid=16293): Terminated: ok {rc=0} 06:11:49.049857 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16290): Process ended prematurely: osmo-stp_10.42.42.5(pid=16290) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16290)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 06:11:49.059816 tst iperf3.py:8: Test FAILED (8.1 sec) 06:11:49.087407 run osmo-hlr_10.42.42.2(pid=16287): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16287)] 06:11:49.136551 run osmo-hlr_10.42.42.2(pid=16287): stdout: | (launched: 2022-12-14_06:11:45.377400) 06:11:49.187130 run osmo-hlr_10.42.42.2(pid=16287): stderr: | 20221214061145577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061145577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061145577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061145577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061145577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061145577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061145590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061145599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061145599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061145599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:49.237926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16282): Terminating (SIGTERM) 06:11:49.278890 run iperf3-srv_10.42.42.10(pid=16283): Terminating (SIGTERM) 06:11:49.319750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16286): Terminating (SIGTERM) 06:11:49.361185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16289): Terminating (SIGTERM) 06:11:49.402175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16292): Terminating (SIGTERM) 06:11:49.443221 --- ParallelTerminationStrategy: PID 16282 died... 06:11:49.462866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16282): Terminated: ok {rc=0} 06:11:49.507464 --- ParallelTerminationStrategy: PID 16283 died... 06:11:49.526493 run iperf3-srv_10.42.42.10(pid=16283): Terminated {rc=256} 06:11:49.570923 --- ParallelTerminationStrategy: PID 16286 died... 06:11:49.590022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16286): Terminated: ok {rc=0} 06:11:49.634551 --- ParallelTerminationStrategy: PID 16289 died... 06:11:49.653705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16289): Terminated: ok {rc=0} 06:11:49.698347 --- ParallelTerminationStrategy: PID 16292 died... 06:11:49.717509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16292): Terminated: ok {rc=0} 06:11:49.804778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:11:50.955577 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:50.967334 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:51.037707 tst iperf3m4.py: using LAC 38951 06:11:51.168641 tst iperf3m4.py: using RAC 191 06:11:51.299008 tst iperf3m4.py: using CellId 38951 06:11:51.438359 tst iperf3m4.py: using BVCI 38952 06:11:51.560251 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.572051 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.583624 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.595026 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.606476 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.617941 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.629591 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.640891 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:51.652564 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:51.771632 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:51.893973 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:52.017654 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:52.137184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:11:52.347094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:52.661237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16294): Launched 06:11:52.934619 run iperf3-srv_10.42.42.10(pid=16295): Launched 06:11:53.051423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:11:53.260679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:53.574449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16296): Launched 06:11:53.845897 run iperf3-srv_10.42.42.10(pid=16297): Launched 06:11:53.962042 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:11:54.171213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:54.484938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Launched 06:11:54.756654 run iperf3-srv_10.42.42.10(pid=16299): Launched 06:11:54.873364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:11:55.082173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:55.395516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16300): Launched 06:11:55.667516 run iperf3-srv_10.42.42.10(pid=16301): Launched 06:11:55.783489 tst iperf3m4.py:8: start network... 06:11:55.992100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:56.476010 run create_hlr_db(pid=16302): Launched 06:11:56.611421 bus /gobi_6: Setting Powered False 06:11:57.672891 run create_hlr_db(pid=16302): Terminated: ok {rc=0} 06:11:58.138327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16304): Launched 06:11:58.470320 run osmo-hlr_10.42.42.2(pid=16305): Launched 06:11:58.595839 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:59.174088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16307): Launched 06:11:59.506681 run osmo-stp_10.42.42.5(pid=16308): Launched 06:11:59.633177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:00.206832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16310): Launched 06:12:00.340361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:00.622124 run patchelf(pid=16311): Launched 06:12:00.805896 run osmo-stp_10.42.42.5(pid=16308): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16308)] 06:12:00.962191 run osmo-stp_10.42.42.5(pid=16308): stdout: | (launched: 2022-12-14_06:11:59.445765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:01.106938 run osmo-stp_10.42.42.5(pid=16308): stderr: | 20221214061159637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061159637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061159637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061159638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061159638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061159638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061159638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:01.252097 run osmo-stp_10.42.42.5(pid=16308): stdout: | (launched: 2022-12-14_06:11:59.445765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:01.390926 run osmo-stp_10.42.42.5(pid=16308): stderr: | 20221214061159637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061159637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061159637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061159638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061159638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061159638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061159638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:01.556151 run patchelf(pid=16311): Terminating (SIGINT) 06:12:01.745304 run patchelf(pid=16311): Terminated: ok {rc=0} 06:12:01.881968 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16308): Process ended prematurely: osmo-stp_10.42.42.5(pid=16308) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16308)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:12:01.893037 tst iperf3m4.py:8: Test FAILED (11.0 sec) 06:12:01.922813 run osmo-hlr_10.42.42.2(pid=16305): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16305)] 06:12:01.974139 run osmo-hlr_10.42.42.2(pid=16305): stdout: | (launched: 2022-12-14_06:11:58.409339) 06:12:02.027638 run osmo-hlr_10.42.42.2(pid=16305): stderr: | 20221214061158610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061158610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061158610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061158610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061158610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061158610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061158622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061158630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061158630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061158630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:02.081862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16294): Terminating (SIGTERM) 06:12:02.125460 run iperf3-srv_10.42.42.10(pid=16295): Terminating (SIGTERM) 06:12:02.168810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16296): Terminating (SIGTERM) 06:12:02.211178 run iperf3-srv_10.42.42.10(pid=16297): Terminating (SIGTERM) 06:12:02.253353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Terminating (SIGTERM) 06:12:02.295609 run iperf3-srv_10.42.42.10(pid=16299): Terminating (SIGTERM) 06:12:02.338543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16300): Terminating (SIGTERM) 06:12:02.382399 run iperf3-srv_10.42.42.10(pid=16301): Terminating (SIGTERM) 06:12:02.423502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16304): Terminating (SIGTERM) 06:12:02.469113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16307): Terminating (SIGTERM) 06:12:02.511321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16310): Terminating (SIGTERM) 06:12:02.554322 --- ParallelTerminationStrategy: PID 16294 died... 06:12:02.574721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16294): Terminated: ok {rc=0} 06:12:02.621723 --- ParallelTerminationStrategy: PID 16295 died... 06:12:02.641636 run iperf3-srv_10.42.42.10(pid=16295): Terminated {rc=256} 06:12:02.688480 --- ParallelTerminationStrategy: PID 16296 died... 06:12:02.708624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16296): Terminated: ok {rc=0} 06:12:02.755156 --- ParallelTerminationStrategy: PID 16297 died... 06:12:02.775029 run iperf3-srv_10.42.42.10(pid=16297): Terminated {rc=256} 06:12:02.821537 --- ParallelTerminationStrategy: PID 16298 died... 06:12:02.841584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Terminated: ok {rc=0} 06:12:02.888362 --- ParallelTerminationStrategy: PID 16299 died... 06:12:02.908172 run iperf3-srv_10.42.42.10(pid=16299): Terminated {rc=256} 06:12:02.954759 --- ParallelTerminationStrategy: PID 16300 died... 06:12:02.974503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16300): Terminated: ok {rc=0} 06:12:03.021195 --- ParallelTerminationStrategy: PID 16301 died... 06:12:03.040773 run iperf3-srv_10.42.42.10(pid=16301): Terminated {rc=256} 06:12:03.087713 --- ParallelTerminationStrategy: PID 16304 died... 06:12:03.107635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16304): Terminated: ok {rc=0} 06:12:03.154272 --- ParallelTerminationStrategy: PID 16307 died... 06:12:03.173990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16307): Terminated: ok {rc=0} 06:12:03.220372 --- ParallelTerminationStrategy: PID 16310 died... 06:12:03.240193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16310): Terminated: ok {rc=0} 06:12:03.329490 bus /gobi_4: Setting Powered False 06:12:04.428081 bus /gobi_4: Setting Powered False 06:12:05.547669 bus /gobi_1: Setting Powered False 06:12:06.647170 bus /gobi_1: Setting Powered False 06:12:07.764104 bus /gobi_0: Setting Powered False 06:12:08.863195 bus /gobi_0: Setting Powered False 06:12:09.981432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:12:11.084884 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.096753 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:12:11.167716 tst ping.py: using LAC 38952 06:12:11.287184 tst ping.py: using RAC 192 06:12:11.408230 tst ping.py: using CellId 38952 06:12:11.528895 tst ping.py: using BVCI 38953 06:12:11.640029 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.651010 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.661830 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.672905 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.684100 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.695287 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.706542 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:11.717624 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:12:11.838567 tst ping.py:19: start network... 06:12:12.060603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:12.569547 run create_hlr_db(pid=16312): Launched 06:12:12.702191 bus /gobi_6: Setting Powered False 06:12:13.766354 run create_hlr_db(pid=16312): Terminated: ok {rc=0} 06:12:14.203288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16314): Launched 06:12:14.509708 run osmo-hlr_10.42.42.2(pid=16315): Launched 06:12:14.627388 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:15.169432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16317): Launched 06:12:15.474637 run osmo-stp_10.42.42.5(pid=16318): Launched 06:12:15.592122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:16.153985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16320): Launched 06:12:16.285518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:16.552218 run patchelf(pid=16321): Launched 06:12:16.740408 run osmo-stp_10.42.42.5(pid=16318): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16318)] 06:12:16.874853 run osmo-stp_10.42.42.5(pid=16318): stdout: | (launched: 2022-12-14_06:12:15.418031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:17.010516 run osmo-stp_10.42.42.5(pid=16318): stderr: | 20221214061215588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061215588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061215588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061215589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061215589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061215590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061215590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:17.145819 run osmo-stp_10.42.42.5(pid=16318): stdout: | (launched: 2022-12-14_06:12:15.418031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:17.273516 run osmo-stp_10.42.42.5(pid=16318): stderr: | 20221214061215588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061215588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061215588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061215589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061215589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061215590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061215590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:17.422462 run patchelf(pid=16321): Terminating (SIGINT) 06:12:17.594390 run patchelf(pid=16321): Terminated: ok {rc=0} 06:12:17.718509 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16318): Process ended prematurely: osmo-stp_10.42.42.5(pid=16318) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16318)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 06:12:17.727725 tst ping.py:22: Test FAILED (6.6 sec) 06:12:17.754943 run osmo-hlr_10.42.42.2(pid=16315): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16315)] 06:12:17.804031 run osmo-hlr_10.42.42.2(pid=16315): stdout: | (launched: 2022-12-14_06:12:14.453182) 06:12:17.854084 run osmo-hlr_10.42.42.2(pid=16315): stderr: | 20221214061214629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061214629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061214629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061214629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061214629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061214629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061214642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061214651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061214651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061214651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:17.904741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16314): Terminating (SIGTERM) 06:12:17.945493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16317): Terminating (SIGTERM) 06:12:17.986245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16320): Terminating (SIGTERM) 06:12:18.027238 --- ParallelTerminationStrategy: PID 16314 died... 06:12:18.047103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16314): Terminated: ok {rc=0} 06:12:18.092131 --- ParallelTerminationStrategy: PID 16317 died... 06:12:18.111518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16317): Terminated: ok {rc=0} 06:12:18.156087 --- ParallelTerminationStrategy: PID 16320 died... 06:12:18.175351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16320): Terminated: ok {rc=0} 06:12:18.262876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:12:19.351789 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:19.363727 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:12:19.437455 tst ping_idle_ping.py: using LAC 38953 06:12:19.568236 tst ping_idle_ping.py: using RAC 193 06:12:19.696821 tst ping_idle_ping.py: using CellId 38953 06:12:19.826667 tst ping_idle_ping.py: using BVCI 38954 06:12:19.947865 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:19.959924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:19.971514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:19.983078 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:19.994525 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:20.006043 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:20.017694 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:12:20.029270 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:12:20.146427 tst ping_idle_ping.py:24: start network... 06:12:20.353639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:20.830781 run create_hlr_db(pid=16322): Launched 06:12:20.948113 bus /gobi_6: Setting Powered False 06:12:22.010047 run create_hlr_db(pid=16322): Terminated: ok {rc=0} 06:12:22.459765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16324): Launched 06:12:22.787326 run osmo-hlr_10.42.42.2(pid=16325): Launched 06:12:22.912739 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:23.482567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16327): Launched 06:12:23.811465 run osmo-stp_10.42.42.5(pid=16328): Launched 06:12:23.936004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:24.500734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16330): Launched 06:12:24.625522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:24.902573 run patchelf(pid=16331): Launched 06:12:25.084412 run osmo-stp_10.42.42.5(pid=16328): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16328)] 06:12:25.223432 run osmo-stp_10.42.42.5(pid=16328): stdout: | (launched: 2022-12-14_06:12:23.751237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:25.364192 run osmo-stp_10.42.42.5(pid=16328): stderr: | 20221214061223944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061223944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061223944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061223945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061223945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061223945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061223945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:25.504060 run osmo-stp_10.42.42.5(pid=16328): stdout: | (launched: 2022-12-14_06:12:23.751237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:25.638247 run osmo-stp_10.42.42.5(pid=16328): stderr: | 20221214061223944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061223944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061223944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061223945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061223945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061223945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061223945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:25.796603 run patchelf(pid=16331): Terminating (SIGINT) 06:12:25.978979 run patchelf(pid=16331): Terminated: ok {rc=0} 06:12:26.111046 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16328): Process ended prematurely: osmo-stp_10.42.42.5(pid=16328) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16328)] [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:12:26.120706 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:12:26.149239 run osmo-hlr_10.42.42.2(pid=16325): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16325)] 06:12:26.199233 run osmo-hlr_10.42.42.2(pid=16325): stdout: | (launched: 2022-12-14_06:12:22.727463) 06:12:26.251184 run osmo-hlr_10.42.42.2(pid=16325): stderr: | 20221214061222927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061222927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061222927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061222927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061222927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061222927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061222938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061222948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061222948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061222948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:26.303530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16324): Terminating (SIGTERM) 06:12:26.345571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16327): Terminating (SIGTERM) 06:12:26.388113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16330): Terminating (SIGTERM) 06:12:26.430222 --- ParallelTerminationStrategy: PID 16324 died... 06:12:26.450381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16324): Terminated: ok {rc=0} 06:12:26.496601 --- ParallelTerminationStrategy: PID 16327 died... 06:12:26.516173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16327): Terminated: ok {rc=0} 06:12:26.562959 --- ParallelTerminationStrategy: PID 16330 died... 06:12:26.582787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16330): Terminated: ok {rc=0} 06:12:26.671226 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:12:27.974342 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:27.981197 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:12:28.013911 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 06:12:28.053293 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 06:12:28.140547 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:12:28.172458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 06:12:28.210474 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 06:12:28.815593 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 06:12:28.866469 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:28.877955 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:28.929357 tst cs_paging_gprs_active.py: using LAC 38954 06:12:29.051951 tst cs_paging_gprs_active.py: using RAC 194 06:12:29.175672 tst cs_paging_gprs_active.py: using CellId 38954 06:12:29.299057 tst cs_paging_gprs_active.py: using BVCI 38955 06:12:29.414636 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.425934 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.436904 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.447966 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.459333 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.470738 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.482220 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.493502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.504892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:29.625458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:29.744598 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:12:29.955375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:30.270932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16337): Launched 06:12:30.544275 run iperf3-srv_10.42.42.10(pid=16338): Launched 06:12:30.662155 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:12:30.873864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:31.205734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16339): Launched 06:12:31.501682 run iperf3-srv_10.42.42.10(pid=16340): Launched 06:12:31.631383 tst cs_paging_gprs_active.py:38: start network... 06:12:31.847424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:32.342960 run create_hlr_db(pid=16341): Launched 06:12:32.462391 bus /gobi_6: Setting Powered False 06:12:33.523968 run create_hlr_db(pid=16341): Terminated: ok {rc=0} 06:12:33.981464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16343): Launched 06:12:34.315697 run osmo-hlr_10.42.42.2(pid=16344): Launched 06:12:34.443672 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:35.019238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16346): Launched 06:12:35.353148 run osmo-stp_10.42.42.5(pid=16347): Launched 06:12:35.479684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:36.052259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16349): Launched 06:12:36.179682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:36.461804 run patchelf(pid=16350): Launched 06:12:36.645798 run osmo-stp_10.42.42.5(pid=16347): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16347)] 06:12:36.786156 run osmo-stp_10.42.42.5(pid=16347): stdout: | (launched: 2022-12-14_06:12:35.291882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:36.928469 run osmo-stp_10.42.42.5(pid=16347): stderr: | 20221214061235486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061235486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061235486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061235487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061235487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061235487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061235487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:37.070665 run osmo-stp_10.42.42.5(pid=16347): stdout: | (launched: 2022-12-14_06:12:35.291882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:37.207666 run osmo-stp_10.42.42.5(pid=16347): stderr: | 20221214061235486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061235486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061235486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061235487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061235487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061235487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061235487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:37.368627 run patchelf(pid=16350): Terminating (SIGINT) 06:12:37.553948 run patchelf(pid=16350): Terminated: ok {rc=0} 06:12:37.687491 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16347): Process ended prematurely: osmo-stp_10.42.42.5(pid=16347) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16347)] [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 06:12:37.697761 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:12:37.726197 run osmo-hlr_10.42.42.2(pid=16344): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16344)] 06:12:37.776286 run osmo-hlr_10.42.42.2(pid=16344): stdout: | (launched: 2022-12-14_06:12:34.254591) 06:12:37.828006 run osmo-hlr_10.42.42.2(pid=16344): stderr: | 20221214061234453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061234453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061234453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061234453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061234453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061234454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061234466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061234475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061234476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061234476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:37.880448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16337): Terminating (SIGTERM) 06:12:37.922297 run iperf3-srv_10.42.42.10(pid=16338): Terminating (SIGTERM) 06:12:37.964715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16339): Terminating (SIGTERM) 06:12:38.006831 run iperf3-srv_10.42.42.10(pid=16340): Terminating (SIGTERM) 06:12:38.048658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16343): Terminating (SIGTERM) 06:12:38.091254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16346): Terminating (SIGTERM) 06:12:38.133687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16349): Terminating (SIGTERM) 06:12:38.175811 --- ParallelTerminationStrategy: PID 16337 died... 06:12:38.195952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16337): Terminated: ok {rc=0} 06:12:38.242939 --- ParallelTerminationStrategy: PID 16338 died... 06:12:38.262536 run iperf3-srv_10.42.42.10(pid=16338): Terminated {rc=256} 06:12:38.308854 --- ParallelTerminationStrategy: PID 16339 died... 06:12:38.329056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16339): Terminated: ok {rc=0} 06:12:38.375108 --- ParallelTerminationStrategy: PID 16340 died... 06:12:38.394713 run iperf3-srv_10.42.42.10(pid=16340): Terminated {rc=256} 06:12:38.440598 --- ParallelTerminationStrategy: PID 16343 died... 06:12:38.460214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16343): Terminated: ok {rc=0} 06:12:38.506078 --- ParallelTerminationStrategy: PID 16346 died... 06:12:38.525836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16346): Terminated: ok {rc=0} 06:12:38.572096 --- ParallelTerminationStrategy: PID 16349 died... 06:12:38.591742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16349): Terminated: ok {rc=0} 06:12:38.679587 bus /gobi_0: Setting Powered False 06:12:39.778515 bus /gobi_0: Setting Powered False 06:12:40.894501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 06:12:42.046143 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.058605 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:42.117589 tst iperf3.py: using LAC 38955 06:12:42.240625 tst iperf3.py: using RAC 195 06:12:42.361749 tst iperf3.py: using CellId 38955 06:12:42.485192 tst iperf3.py: using BVCI 38956 06:12:42.598914 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.610575 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.621885 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.632940 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.644855 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.656771 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.668926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.680943 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:42.693340 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:42.814466 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:12:43.038974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:43.374856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16351): Launched 06:12:43.664073 run iperf3-srv_10.42.42.10(pid=16352): Launched 06:12:43.787953 tst iperf3.py:8: start network... 06:12:44.012182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:44.528349 run create_hlr_db(pid=16353): Launched 06:12:44.662591 bus /gobi_6: Setting Powered False 06:12:45.727305 run create_hlr_db(pid=16353): Terminated: ok {rc=0} 06:12:46.213727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16355): Launched 06:12:46.572351 run osmo-hlr_10.42.42.2(pid=16356): Launched 06:12:46.824877 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:47.497502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16358): Launched 06:12:47.830514 run osmo-stp_10.42.42.5(pid=16359): Launched 06:12:47.956457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:48.529992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16361): Launched 06:12:48.656812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:48.938574 run patchelf(pid=16362): Launched 06:12:49.123129 run osmo-stp_10.42.42.5(pid=16359): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16359)] 06:12:49.264066 run osmo-stp_10.42.42.5(pid=16359): stdout: | (launched: 2022-12-14_06:12:47.769770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:49.406091 run osmo-stp_10.42.42.5(pid=16359): stderr: | 20221214061247965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061247965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061247965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061247965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061247966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061247966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061247966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:49.548448 run osmo-stp_10.42.42.5(pid=16359): stdout: | (launched: 2022-12-14_06:12:47.769770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:49.683745 run osmo-stp_10.42.42.5(pid=16359): stderr: | 20221214061247965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061247965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061247965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061247965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061247966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061247966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061247966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:49.844484 run patchelf(pid=16362): Terminating (SIGINT) 06:12:50.030563 run patchelf(pid=16362): Terminated: ok {rc=0} 06:12:50.165274 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16359): Process ended prematurely: osmo-stp_10.42.42.5(pid=16359) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16359)] [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 06:12:50.175536 tst iperf3.py:8: Test FAILED (8.2 sec) 06:12:50.204123 run osmo-hlr_10.42.42.2(pid=16356): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16356)] 06:12:50.254523 run osmo-hlr_10.42.42.2(pid=16356): stdout: | (launched: 2022-12-14_06:12:46.507777) 06:12:50.306431 run osmo-hlr_10.42.42.2(pid=16356): stderr: | 20221214061246818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061246818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061246818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061246818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061246818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061246818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061246832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061246839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061246840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061246840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:50.359048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16351): Terminating (SIGTERM) 06:12:50.401114 run iperf3-srv_10.42.42.10(pid=16352): Terminating (SIGTERM) 06:12:50.443193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16355): Terminating (SIGTERM) 06:12:50.485605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16358): Terminating (SIGTERM) 06:12:50.528206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16361): Terminating (SIGTERM) 06:12:50.570869 --- ParallelTerminationStrategy: PID 16351 died... 06:12:50.591315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16351): Terminated: ok {rc=0} 06:12:50.637827 --- ParallelTerminationStrategy: PID 16352 died... 06:12:50.657540 run iperf3-srv_10.42.42.10(pid=16352): Terminated {rc=256} 06:12:50.703516 --- ParallelTerminationStrategy: PID 16355 died... 06:12:50.723312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16355): Terminated: ok {rc=0} 06:12:50.769521 --- ParallelTerminationStrategy: PID 16358 died... 06:12:50.789138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16358): Terminated: ok {rc=0} 06:12:50.835300 --- ParallelTerminationStrategy: PID 16361 died... 06:12:50.855060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16361): Terminated: ok {rc=0} 06:12:50.943304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 06:12:52.095854 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.109033 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:52.163443 tst iperf3m4.py: using LAC 38956 06:12:52.292688 tst iperf3m4.py: using RAC 196 06:12:52.423011 tst iperf3m4.py: using CellId 38956 06:12:52.553239 tst iperf3m4.py: using BVCI 38957 06:12:52.674800 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.687215 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.699146 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.711119 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.723660 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.736084 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.748665 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.761229 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:52.773938 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:52.896085 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:53.017908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:53.139702 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:53.259898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:12:53.484718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:53.819328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16363): Launched 06:12:54.108677 run iperf3-srv_10.42.42.10(pid=16364): Launched 06:12:54.233294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:12:54.457415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:54.792002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Launched 06:12:55.082287 run iperf3-srv_10.42.42.10(pid=16366): Launched 06:12:55.206830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:12:55.431243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:55.766153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16367): Launched 06:12:56.055831 run iperf3-srv_10.42.42.10(pid=16368): Launched 06:12:56.180110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:12:56.403933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:56.738017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16369): Launched 06:12:57.027298 run iperf3-srv_10.42.42.10(pid=16370): Launched 06:12:57.151848 tst iperf3m4.py:8: start network... 06:12:57.377916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:57.893734 run create_hlr_db(pid=16371): Launched 06:12:58.027859 bus /gobi_6: Setting Powered False 06:12:59.092887 run create_hlr_db(pid=16371): Terminated: ok {rc=0} 06:12:59.537673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16373): Launched 06:12:59.849592 run osmo-hlr_10.42.42.2(pid=16374): Launched 06:12:59.968183 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:00.511651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16376): Launched 06:13:00.823240 run osmo-stp_10.42.42.5(pid=16377): Launched 06:13:01.059557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:13:01.702165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16379): Launched 06:13:01.841670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:13:02.133491 run patchelf(pid=16380): Launched 06:13:02.331598 run osmo-stp_10.42.42.5(pid=16377): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16377)] 06:13:02.472290 run osmo-stp_10.42.42.5(pid=16377): stdout: | (launched: 2022-12-14_06:13:00.765460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:02.614821 run osmo-stp_10.42.42.5(pid=16377): stderr: | 20221214061300988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061300988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061300989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061300989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061300990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061300990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061300990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:02.757342 run osmo-stp_10.42.42.5(pid=16377): stdout: | (launched: 2022-12-14_06:13:00.765460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:02.893303 run osmo-stp_10.42.42.5(pid=16377): stderr: | 20221214061300988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061300988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061300989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061300989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061300990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061300990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061300990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:03.054685 run patchelf(pid=16380): Terminating (SIGINT) 06:13:03.241152 run patchelf(pid=16380): Terminated: ok {rc=0} 06:13:03.375549 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16377): Process ended prematurely: osmo-stp_10.42.42.5(pid=16377) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16377)] [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 06:13:03.385970 tst iperf3m4.py:8: Test FAILED (11.3 sec) 06:13:03.415204 run osmo-hlr_10.42.42.2(pid=16374): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16374)] 06:13:03.465973 run osmo-hlr_10.42.42.2(pid=16374): stdout: | (launched: 2022-12-14_06:12:59.792000) 06:13:03.518305 run osmo-hlr_10.42.42.2(pid=16374): stderr: | 20221214061259969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061259969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061259969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061259969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061259969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061259969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061259981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061259989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061259990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061259990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:03.571002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16363): Terminating (SIGTERM) 06:13:03.613414 run iperf3-srv_10.42.42.10(pid=16364): Terminating (SIGTERM) 06:13:03.655670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Terminating (SIGTERM) 06:13:03.698139 run iperf3-srv_10.42.42.10(pid=16366): Terminating (SIGTERM) 06:13:03.740086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16367): Terminating (SIGTERM) 06:13:03.782577 run iperf3-srv_10.42.42.10(pid=16368): Terminating (SIGTERM) 06:13:03.824612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16369): Terminating (SIGTERM) 06:13:03.866842 run iperf3-srv_10.42.42.10(pid=16370): Terminating (SIGTERM) 06:13:03.909073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16373): Terminating (SIGTERM) 06:13:03.951564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16376): Terminating (SIGTERM) 06:13:03.993827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16379): Terminating (SIGTERM) 06:13:04.036308 --- ParallelTerminationStrategy: PID 16363 died... 06:13:04.056828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16363): Terminated: ok {rc=0} 06:13:04.103802 --- ParallelTerminationStrategy: PID 16364 died... 06:13:04.123926 run iperf3-srv_10.42.42.10(pid=16364): Terminated {rc=256} 06:13:04.170533 --- ParallelTerminationStrategy: PID 16365 died... 06:13:04.190782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Terminated: ok {rc=0} 06:13:04.237231 --- ParallelTerminationStrategy: PID 16366 died... 06:13:04.256990 run iperf3-srv_10.42.42.10(pid=16366): Terminated {rc=256} 06:13:04.303352 --- ParallelTerminationStrategy: PID 16367 died... 06:13:04.323229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16367): Terminated: ok {rc=0} 06:13:04.369563 --- ParallelTerminationStrategy: PID 16368 died... 06:13:04.389466 run iperf3-srv_10.42.42.10(pid=16368): Terminated {rc=256} 06:13:04.436101 --- ParallelTerminationStrategy: PID 16369 died... 06:13:04.456057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16369): Terminated: ok {rc=0} 06:13:04.502480 --- ParallelTerminationStrategy: PID 16370 died... 06:13:04.522306 run iperf3-srv_10.42.42.10(pid=16370): Terminated {rc=256} 06:13:04.568595 --- ParallelTerminationStrategy: PID 16373 died... 06:13:04.588648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16373): Terminated: ok {rc=0} 06:13:04.635271 --- ParallelTerminationStrategy: PID 16376 died... 06:13:04.655159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16376): Terminated: ok {rc=0} 06:13:04.701999 --- ParallelTerminationStrategy: PID 16379 died... 06:13:04.721812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16379): Terminated: ok {rc=0} 06:13:04.809606 bus /gobi_4: Setting Powered False 06:13:05.908642 bus /gobi_4: Setting Powered False 06:13:07.024666 bus /gobi_1: Setting Powered False 06:13:08.121024 bus /gobi_1: Setting Powered False 06:13:09.234946 bus /gobi_0: Setting Powered False 06:13:10.333862 bus /gobi_0: Setting Powered False 06:13:11.450335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 06:13:12.553836 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:12.566295 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:13:12.619897 tst ping.py: using LAC 38957 06:13:12.750278 tst ping.py: using RAC 197 06:13:12.879047 tst ping.py: using CellId 38957 06:13:12.998932 tst ping.py: using BVCI 38958 06:13:13.110963 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.122623 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.134043 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.145383 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.156886 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.168504 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.180144 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:13.191496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:13:13.311440 tst ping.py:19: start network... 06:13:13.532317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:14.036476 run create_hlr_db(pid=16381): Launched 06:13:14.168579 bus /gobi_6: Setting Powered False 06:13:15.233233 run create_hlr_db(pid=16381): Terminated: ok {rc=0} 06:13:15.687039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Launched 06:13:16.017899 run osmo-hlr_10.42.42.2(pid=16384): Launched 06:13:16.167908 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:16.901924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Launched 06:13:17.241791 run osmo-stp_10.42.42.5(pid=16387): Launched 06:13:17.429854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:13:17.960655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16389): Launched 06:13:18.078404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:13:18.339361 run patchelf(pid=16390): Launched 06:13:18.510751 run osmo-stp_10.42.42.5(pid=16387): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] 06:13:18.641108 run osmo-stp_10.42.42.5(pid=16387): stdout: | (launched: 2022-12-14_06:13:17.176478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:18.774146 run osmo-stp_10.42.42.5(pid=16387): stderr: | 20221214061317382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061317382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061317382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061317382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061317383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061317383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061317383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:18.907064 run osmo-stp_10.42.42.5(pid=16387): stdout: | (launched: 2022-12-14_06:13:17.176478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:19.033357 run osmo-stp_10.42.42.5(pid=16387): stderr: | 20221214061317382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061317382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061317382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061317382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061317383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061317383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061317383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:19.183181 run patchelf(pid=16390): Terminating (SIGINT) 06:13:19.356064 run patchelf(pid=16390): Terminated: ok {rc=0} 06:13:19.481099 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16387): Process ended prematurely: osmo-stp_10.42.42.5(pid=16387) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 06:13:19.490271 tst ping.py:22: Test FAILED (6.9 sec) 06:13:19.516784 run osmo-hlr_10.42.42.2(pid=16384): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16384)] 06:13:19.565158 run osmo-hlr_10.42.42.2(pid=16384): stdout: | (launched: 2022-12-14_06:13:15.954994) 06:13:19.614502 run osmo-hlr_10.42.42.2(pid=16384): stderr: | 20221214061316366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061316366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061316366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061316366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061316366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061316367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061316393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061316415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061316415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061316415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:19.664646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Terminating (SIGTERM) 06:13:19.704893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Terminating (SIGTERM) 06:13:19.745134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16389): Terminating (SIGTERM) 06:13:19.785397 --- ParallelTerminationStrategy: PID 16383 died... 06:13:19.805083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Terminated: ok {rc=0} 06:13:19.849728 --- ParallelTerminationStrategy: PID 16386 died... 06:13:19.868832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Terminated: ok {rc=0} 06:13:19.913836 --- ParallelTerminationStrategy: PID 16389 died... 06:13:19.933456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16389): Terminated: ok {rc=0} 06:13:20.021831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 06:13:21.110267 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.122626 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:13:21.180460 tst ping_idle_ping.py: using LAC 38958 06:13:21.301092 tst ping_idle_ping.py: using RAC 198 06:13:21.429889 tst ping_idle_ping.py: using CellId 38958 06:13:21.557540 tst ping_idle_ping.py: using BVCI 38959 06:13:21.672768 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.684530 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.695938 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.707399 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.719248 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.731114 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.742832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:13:21.754599 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:13:21.874431 tst ping_idle_ping.py:24: start network... 06:13:22.097663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:22.608428 run create_hlr_db(pid=16391): Launched 06:13:22.740855 bus /gobi_6: Setting Powered False 06:13:23.806630 run create_hlr_db(pid=16391): Terminated: ok {rc=0} 06:13:24.246537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16393): Launched 06:13:24.555681 run osmo-hlr_10.42.42.2(pid=16394): Launched 06:13:24.674409 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:25.205567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16396): Launched 06:13:25.512665 run osmo-stp_10.42.42.5(pid=16397): Launched 06:13:25.631290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:13:26.162996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16399): Launched 06:13:26.281235 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:13:26.542084 run patchelf(pid=16400): Launched 06:13:26.712553 run osmo-stp_10.42.42.5(pid=16397): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16397)] 06:13:26.842950 run osmo-stp_10.42.42.5(pid=16397): stdout: | (launched: 2022-12-14_06:13:25.455219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:26.974716 run osmo-stp_10.42.42.5(pid=16397): stderr: | 20221214061325625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061325626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061325626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061325626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061325627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061325627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061325627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:27.107011 run osmo-stp_10.42.42.5(pid=16397): stdout: | (launched: 2022-12-14_06:13:25.455219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:27.233252 run osmo-stp_10.42.42.5(pid=16397): stderr: | 20221214061325625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061325626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061325626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061325626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061325627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061325627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061325627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:27.382109 run patchelf(pid=16400): Terminating (SIGINT) 06:13:27.555129 run patchelf(pid=16400): Terminated: ok {rc=0} 06:13:27.679214 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16397): Process ended prematurely: osmo-stp_10.42.42.5(pid=16397) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16397)] [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 06:13:27.688310 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:13:27.715014 run osmo-hlr_10.42.42.2(pid=16394): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16394)] 06:13:27.763652 run osmo-hlr_10.42.42.2(pid=16394): stdout: | (launched: 2022-12-14_06:13:24.498193) 06:13:27.813674 run osmo-hlr_10.42.42.2(pid=16394): stderr: | 20221214061324673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061324673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061324673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061324673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061324673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061324673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061324692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061324702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061324702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061324702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:27.863952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16393): Terminating (SIGTERM) 06:13:27.904520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16396): Terminating (SIGTERM) 06:13:27.945377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16399): Terminating (SIGTERM) 06:13:27.986348 --- ParallelTerminationStrategy: PID 16393 died... 06:13:28.006202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16393): Terminated: ok {rc=0} 06:13:28.050868 --- ParallelTerminationStrategy: PID 16396 died... 06:13:28.070167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16396): Terminated: ok {rc=0} 06:13:28.114632 --- ParallelTerminationStrategy: PID 16399 died... 06:13:28.133919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16399): Terminated: ok {rc=0} 06:13:28.220871 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:13:29.529565 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:29.536318 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:13:29.568447 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:13:29.603689 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:13:29.656736 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:13:29.688913 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:13:29.723605 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:13:30.287283 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:13:30.292602 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.303938 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:13:30.373574 tst switch_tch_pdch.py: using LAC 38959 06:13:30.502721 tst switch_tch_pdch.py: using RAC 199 06:13:30.633178 tst switch_tch_pdch.py: using CellId 38959 06:13:30.763173 tst switch_tch_pdch.py: using BVCI 38960 06:13:30.895552 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.909366 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.921668 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.933851 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.947027 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.960330 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.978587 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:13:30.992347 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:13:31.117096 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:13:31.239045 tst switch_tch_pdch.py:51: start network... 06:13:31.487429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:32.003429 run create_hlr_db(pid=16404): Launched 06:13:32.168481 bus /gobi_6: Setting Powered False 06:13:33.233139 run create_hlr_db(pid=16404): Terminated: ok {rc=0} 06:13:33.671285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16406): Launched 06:13:33.978385 run osmo-hlr_10.42.42.2(pid=16407): Launched 06:13:34.095398 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:34.633929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16409): Launched 06:13:34.940617 run osmo-stp_10.42.42.5(pid=16410): Launched 06:13:35.058375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:13:35.589637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16412): Launched 06:13:35.707217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:13:35.967235 run patchelf(pid=16413): Launched 06:13:36.137517 run osmo-stp_10.42.42.5(pid=16410): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16410)] 06:13:36.267734 run osmo-stp_10.42.42.5(pid=16410): stdout: | (launched: 2022-12-14_06:13:34.883542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:36.399994 run osmo-stp_10.42.42.5(pid=16410): stderr: | 20221214061335053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061335053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061335054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061335054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061335055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061335055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061335055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:36.532088 run osmo-stp_10.42.42.5(pid=16410): stdout: | (launched: 2022-12-14_06:13:34.883542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:36.657916 run osmo-stp_10.42.42.5(pid=16410): stderr: | 20221214061335053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061335053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061335054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061335054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061335055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061335055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061335055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:36.807321 run patchelf(pid=16413): Terminating (SIGINT) 06:13:36.979776 run patchelf(pid=16413): Terminated: ok {rc=0} 06:13:37.104249 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16410): Process ended prematurely: osmo-stp_10.42.42.5(pid=16410) [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16410)] [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:13:37.113477 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:13:37.140082 run osmo-hlr_10.42.42.2(pid=16407): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16407)] 06:13:37.188600 run osmo-hlr_10.42.42.2(pid=16407): stdout: | (launched: 2022-12-14_06:13:33.921484) 06:13:37.238830 run osmo-hlr_10.42.42.2(pid=16407): stderr: | 20221214061334099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061334099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061334099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061334099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061334099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061334099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061334111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061334120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061334120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061334120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:37.289438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16406): Terminating (SIGTERM) 06:13:37.330040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16409): Terminating (SIGTERM) 06:13:37.370502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16412): Terminating (SIGTERM) 06:13:37.411160 --- ParallelTerminationStrategy: PID 16406 died... 06:13:37.431038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16406): Terminated: ok {rc=0} 06:13:37.475916 --- ParallelTerminationStrategy: PID 16409 died... 06:13:37.495453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16409): Terminated: ok {rc=0} 06:13:37.540395 --- ParallelTerminationStrategy: PID 16412 died... 06:13:37.559914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16412): Terminated: ok {rc=0} 06:13:37.648013 bus /gobi_0: Setting Powered False 06:13:38.748897 bus /gobi_0: Setting Powered False 06:13:39.866331 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:13:41.116129 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:41.122106 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:13:41.153958 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:13:41.188672 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:13:41.241449 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:13:41.273121 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:13:41.307100 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:13:41.862902 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:13:41.868412 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:41.879584 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:13:41.948626 tst switch_tch_pdch.py: using LAC 38960 06:13:42.068518 tst switch_tch_pdch.py: using RAC 200 06:13:42.189351 tst switch_tch_pdch.py: using CellId 38960 06:13:42.308719 tst switch_tch_pdch.py: using BVCI 38961 06:13:42.419551 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.430875 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.441781 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.452582 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.463715 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.475032 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.486401 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:13:42.497581 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:13:42.614070 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:13:42.730443 tst switch_tch_pdch.py:51: start network... 06:13:42.936041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:43.382967 run create_hlr_db(pid=16419): Launched 06:13:43.498933 bus /gobi_6: Setting Powered False 06:13:44.559917 run create_hlr_db(pid=16419): Terminated: ok {rc=0} 06:13:44.978043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16421): Launched 06:13:45.304035 run osmo-hlr_10.42.42.2(pid=16422): Launched 06:13:45.429684 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:45.976419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16424): Launched 06:13:46.317569 run osmo-stp_10.42.42.5(pid=16425): Launched 06:13:46.564092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:13:47.185078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16427): Launched 06:13:47.307116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:13:47.567463 run patchelf(pid=16428): Launched 06:13:47.738417 run osmo-stp_10.42.42.5(pid=16425): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16425)] 06:13:47.868454 run osmo-stp_10.42.42.5(pid=16425): stdout: | (launched: 2022-12-14_06:13:46.256100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:48.000343 run osmo-stp_10.42.42.5(pid=16425): stderr: | 20221214061346545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061346545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061346545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061346546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061346546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061346546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061346546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:48.132280 run osmo-stp_10.42.42.5(pid=16425): stdout: | (launched: 2022-12-14_06:13:46.256100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:48.257863 run osmo-stp_10.42.42.5(pid=16425): stderr: | 20221214061346545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061346545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061346545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061346546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061346546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061346546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061346546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:48.406029 run patchelf(pid=16428): Terminating (SIGINT) 06:13:48.576812 run patchelf(pid=16428): Terminated: ok {rc=0} 06:13:48.700082 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16425): Process ended prematurely: osmo-stp_10.42.42.5(pid=16425) [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16425)] [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:13:48.709212 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:13:48.735760 run osmo-hlr_10.42.42.2(pid=16422): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16422)] 06:13:48.783719 run osmo-hlr_10.42.42.2(pid=16422): stdout: | (launched: 2022-12-14_06:13:45.244188) 06:13:48.833345 run osmo-hlr_10.42.42.2(pid=16422): stderr: | 20221214061345441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061345441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061345442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061345442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061345442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061345442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061345455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061345463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061345463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061345463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:48.883432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16421): Terminating (SIGTERM) 06:13:48.923746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16424): Terminating (SIGTERM) 06:13:48.963892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16427): Terminating (SIGTERM) 06:13:49.004293 --- ParallelTerminationStrategy: PID 16421 died... 06:13:49.023771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16421): Terminated: ok {rc=0} 06:13:49.068048 --- ParallelTerminationStrategy: PID 16424 died... 06:13:49.087031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16424): Terminated: ok {rc=0} 06:13:49.131214 --- ParallelTerminationStrategy: PID 16427 died... 06:13:49.150269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16427): Terminated: ok {rc=0} 06:13:49.236527 bus /gobi_0: Setting Powered False 06:13:50.335720 bus /gobi_0: Setting Powered False 06:13:51.448385 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:trx-lms --------------------------------------------------------------------- 06:13:52.701895 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:52.706451 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 06:13:52.739438 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 06:13:52.746843 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 06:13:52.798654 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 06:13:52.831649 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 06:13:52.838477 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 06:13:53.374920 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 06:13:53.380213 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 06:13:53.391113 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 06:13:53.439210 tst mo_mt_sms.py: using LAC 38961 06:13:53.560180 tst mo_mt_sms.py: using RAC 201 06:13:53.681390 tst mo_mt_sms.py: using CellId 38961 06:13:53.804481 tst mo_mt_sms.py: using BVCI 38962 06:13:53.917227 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 06:13:54.037289 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 06:13:54.155201 tst mo_mt_sms.py:9: start nitb and bts... 06:13:54.377349 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:13:55.039586 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16432): Launched 06:13:55.365773 run osmo-nitb_10.42.42.2(pid=16433): Launched 06:13:55.546347 run osmo-nitb_10.42.42.2(pid=16433): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16433)] 06:13:55.691789 run osmo-nitb_10.42.42.2(pid=16433): stdout: | (launched: 2022-12-14_06:13:55.306013) 06:13:55.839669 run osmo-nitb_10.42.42.2(pid=16433): stderr: | (launched: 2022-12-14_06:13:55.354435) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:13:55.986629 run osmo-nitb_10.42.42.2(pid=16433): stdout: | (launched: 2022-12-14_06:13:55.306013) 06:13:56.128079 run osmo-nitb_10.42.42.2(pid=16433): stderr: | (launched: 2022-12-14_06:13:55.354435) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16433) [trial-2400↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16433)] 06:13:56.489102 tst osmo-nitb_10.42.42.2(pid=16433): stdout: | (launched: 2022-12-14_06:13:55.306013) 06:13:56.620302 tst osmo-nitb_10.42.42.2(pid=16433): stderr: | (launched: 2022-12-14_06:13:55.354435) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:13:56.774511 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16433) [trial-2400↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16433)] [trial-2400↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 06:13:56.783597 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 06:13:56.790799 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16432): Terminating (SIGTERM) 06:13:57.001169 --- ParallelTerminationStrategy: PID 16432 died... 06:13:57.023133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16432): Terminated: ok {rc=0} 06:13:57.112846 bus /sierra_3: Setting Powered False 06:13:58.212431 bus /sierra_3: Setting Powered False 06:13:59.328078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:trx-lms --------------------------------------------------------------------- 06:14:00.527045 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:00.531477 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 06:14:00.565438 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:14:00.592868 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 06:14:00.647976 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 06:14:00.681622 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:14:00.708427 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 06:14:01.271571 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 06:14:01.280556 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:01.299214 tst sms:trx-lms: Using 1 x bts (candidates: 1) 06:14:01.361831 tst mo_mt_sms.py: using LAC 38962 06:14:01.485849 tst mo_mt_sms.py: using RAC 202 06:14:01.608801 tst mo_mt_sms.py: using CellId 38962 06:14:01.733582 tst mo_mt_sms.py: using BVCI 38963 06:14:01.883667 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:01.898699 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:01.910242 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:01.922010 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:01.933902 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:01.945700 tst sms:trx-lms: Using 1 x modem (candidates: 2) 06:14:02.072521 tst sms:trx-lms: Using 1 x modem (candidates: 2) 06:14:02.198606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:02.707684 run create_hlr_db(pid=16437): Launched 06:14:02.840268 bus /sierra_2: Setting Powered False 06:14:03.904582 run create_hlr_db(pid=16437): Terminated: ok {rc=0} 06:14:04.342096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16439): Launched 06:14:04.649601 run osmo-hlr_10.42.42.2(pid=16440): Launched 06:14:04.768283 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:05.306762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16442): Launched 06:14:05.613358 run osmo-stp_10.42.42.5(pid=16443): Launched 06:14:05.730414 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:06.286143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16445): Launched 06:14:06.592894 run osmo-msc_10.42.42.6(pid=16446): Launched 06:14:06.765340 run osmo-stp_10.42.42.5(pid=16443): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16443)] 06:14:06.895482 run osmo-stp_10.42.42.5(pid=16443): stdout: | (launched: 2022-12-14_06:14:05.556720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:07.025158 run osmo-stp_10.42.42.5(pid=16443): stderr: | 20221214061405728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061405728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061405728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061405729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061405729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061405729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061405729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:07.152304 run osmo-stp_10.42.42.5(pid=16443): stdout: | (launched: 2022-12-14_06:14:05.556720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:07.274176 run osmo-stp_10.42.42.5(pid=16443): stderr: | 20221214061405728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061405728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061405728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061405729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061405729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061405729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061405729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:07.420541 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16443): Process ended prematurely: osmo-stp_10.42.42.5(pid=16443) [trial-2400↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16443)] [trial-2400↪sms:trx-lms↪mo_mt_sms.py:16] 06:14:07.429112 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 06:14:07.455077 run osmo-hlr_10.42.42.2(pid=16440): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16440)] 06:14:07.504325 run osmo-hlr_10.42.42.2(pid=16440): stdout: | (launched: 2022-12-14_06:14:04.592772) 06:14:07.553560 run osmo-hlr_10.42.42.2(pid=16440): stderr: | 20221214061404769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061404769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061404769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061404769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061404769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061404769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061404781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061404789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061404789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061404789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:07.622609 run osmo-msc_10.42.42.6(pid=16446): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16446)] 06:14:07.669783 run osmo-msc_10.42.42.6(pid=16446): stdout: | (launched: 2022-12-14_06:14:06.535950) 06:14:07.718985 run osmo-msc_10.42.42.6(pid=16446): stderr: | 20221214061406808 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061406808 DLGLOBAL DEBUG validating counter group 0x7ff626423c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061406808 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061406808 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061406809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061406809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061406810 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061406811 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061406811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061406811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:07.769122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16439): Terminating (SIGTERM) 06:14:07.808996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16442): Terminating (SIGTERM) 06:14:07.849486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16445): Terminating (SIGTERM) 06:14:07.889740 --- ParallelTerminationStrategy: PID 16439 died... 06:14:07.909156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16439): Terminated: ok {rc=0} 06:14:07.953322 --- ParallelTerminationStrategy: PID 16442 died... 06:14:07.972097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16442): Terminated: ok {rc=0} 06:14:08.016065 --- ParallelTerminationStrategy: PID 16445 died... 06:14:08.035036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16445): Terminated: ok {rc=0} 06:14:08.121907 bus /sierra_3: Setting Powered False 06:14:09.222961 bus /sierra_3: Setting Powered False 06:14:10.340777 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-lms --------------------------------------------------------------------- 06:14:11.570120 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:11.575165 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 06:14:11.609572 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 06:14:11.616682 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 06:14:11.653090 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 06:14:11.686798 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 06:14:11.693788 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 06:14:12.213891 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 06:14:12.219066 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 06:14:12.230359 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 06:14:12.278650 tst assert_extension.py: using LAC 38963 06:14:12.408600 tst assert_extension.py: using RAC 203 06:14:12.537597 tst assert_extension.py: using CellId 38963 06:14:12.666548 tst assert_extension.py: using BVCI 38964 06:14:12.786235 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 06:14:12.904332 tst assert_extension.py:10: start nitb and bts... 06:14:13.125163 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:14:13.791522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16452): Launched 06:14:14.118317 run osmo-nitb_10.42.42.2(pid=16453): Launched 06:14:14.298707 run osmo-nitb_10.42.42.2(pid=16453): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16453)] 06:14:14.444556 run osmo-nitb_10.42.42.2(pid=16453): stdout: | (launched: 2022-12-14_06:14:14.058288) 06:14:14.592015 run osmo-nitb_10.42.42.2(pid=16453): stderr: | (launched: 2022-12-14_06:14:14.106922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:14:14.739188 run osmo-nitb_10.42.42.2(pid=16453): stdout: | (launched: 2022-12-14_06:14:14.058288) 06:14:14.880648 run osmo-nitb_10.42.42.2(pid=16453): stderr: | (launched: 2022-12-14_06:14:14.106922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16453): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16453) [trial-2400↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16453)] 06:14:15.241721 tst osmo-nitb_10.42.42.2(pid=16453): stdout: | (launched: 2022-12-14_06:14:14.058288) 06:14:15.372668 tst osmo-nitb_10.42.42.2(pid=16453): stderr: | (launched: 2022-12-14_06:14:14.106922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:14:15.527528 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16453): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16453) [trial-2400↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16453)] [trial-2400↪nitb_ussd:trx-lms↪assert_extension.py:12] 06:14:15.536708 tst assert_extension.py:12: Test FAILED (3.3 sec) 06:14:15.543826 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16452): Terminating (SIGTERM) 06:14:15.754515 --- ParallelTerminationStrategy: PID 16452 died... 06:14:15.776303 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16452): Terminated: ok {rc=0} 06:14:15.874630 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:trx-lms --------------------------------------------------------------------- 06:14:17.087581 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:17.094866 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 06:14:17.140163 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:14:17.176888 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 06:14:17.220333 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 06:14:17.255122 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:14:17.284316 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 06:14:17.808291 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:trx-lms assert_extension.py ---------------------------------------------- 06:14:17.813929 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:17.825101 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 06:14:17.873719 tst assert_extension.py: using LAC 38964 06:14:18.005268 tst assert_extension.py: using RAC 204 06:14:18.133197 tst assert_extension.py: using CellId 38964 06:14:18.263270 tst assert_extension.py: using BVCI 38965 06:14:18.383674 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:18.394690 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:18.405599 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:18.416327 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:18.427789 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:14:18.439050 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 06:14:18.554538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:19.030536 run create_hlr_db(pid=16457): Launched 06:14:19.147133 bus /sierra_2: Setting Powered False 06:14:20.208217 run create_hlr_db(pid=16457): Terminated: ok {rc=0} 06:14:20.655524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16459): Launched 06:14:20.982360 run osmo-hlr_10.42.42.2(pid=16460): Launched 06:14:21.106665 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:21.675641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16462): Launched 06:14:22.002222 run osmo-stp_10.42.42.5(pid=16463): Launched 06:14:22.126967 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:22.715855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16465): Launched 06:14:23.041370 run osmo-msc_10.42.42.6(pid=16466): Launched 06:14:23.223104 run osmo-stp_10.42.42.5(pid=16463): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16463)] 06:14:23.360004 run osmo-stp_10.42.42.5(pid=16463): stdout: | (launched: 2022-12-14_06:14:21.941700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:23.497467 run osmo-stp_10.42.42.5(pid=16463): stderr: | 20221214061422136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061422136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061422136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061422137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061422137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061422137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061422137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:23.634209 run osmo-stp_10.42.42.5(pid=16463): stdout: | (launched: 2022-12-14_06:14:21.941700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:23.764010 run osmo-stp_10.42.42.5(pid=16463): stderr: | 20221214061422136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061422136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061422136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061422137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061422137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061422137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061422137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:23.919295 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16463): Process ended prematurely: osmo-stp_10.42.42.5(pid=16463) [trial-2400↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16463)] [trial-2400↪ussd:trx-lms↪assert_extension.py:17] 06:14:23.928300 tst assert_extension.py:17: Test FAILED (6.1 sec) 06:14:23.956078 run osmo-hlr_10.42.42.2(pid=16460): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16460)] 06:14:24.006477 run osmo-hlr_10.42.42.2(pid=16460): stdout: | (launched: 2022-12-14_06:14:20.922596) 06:14:24.058559 run osmo-hlr_10.42.42.2(pid=16460): stderr: | 20221214061421121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061421121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061421121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061421121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061421121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061421121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061421134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061421142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061421142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061421142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:24.131044 run osmo-msc_10.42.42.6(pid=16466): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16466)] 06:14:24.181605 run osmo-msc_10.42.42.6(pid=16466): stdout: | (launched: 2022-12-14_06:14:22.981334) 06:14:24.233570 run osmo-msc_10.42.42.6(pid=16466): stderr: | 20221214061423305 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061423305 DLGLOBAL DEBUG validating counter group 0x7fc951b76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061423305 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061423305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061423305 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061423306 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061423307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061423308 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061423308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061423308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:24.285874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16459): Terminating (SIGTERM) 06:14:24.327945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16462): Terminating (SIGTERM) 06:14:24.370179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16465): Terminating (SIGTERM) 06:14:24.412741 --- ParallelTerminationStrategy: PID 16459 died... 06:14:24.432933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16459): Terminated: ok {rc=0} 06:14:24.479300 --- ParallelTerminationStrategy: PID 16462 died... 06:14:24.498873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16462): Terminated: ok {rc=0} 06:14:24.545203 --- ParallelTerminationStrategy: PID 16465 died... 06:14:24.564801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16465): Terminated: ok {rc=0} 06:14:24.652569 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:14:25.865479 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:25.872458 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:14:25.906220 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:14:25.933330 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:14:25.985680 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:14:26.020075 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:14:26.048776 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:14:26.594625 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:14:26.647233 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:26.658557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:14:26.727383 tst mo_mt_call.py: using LAC 38965 06:14:26.850057 tst mo_mt_call.py: using RAC 205 06:14:26.972321 tst mo_mt_call.py: using CellId 38965 06:14:27.096116 tst mo_mt_call.py: using BVCI 38966 06:14:27.210239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:27.221310 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:27.232089 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:27.243035 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:27.254365 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:27.265680 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:14:27.388012 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:14:27.506910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:27.993122 run create_hlr_db(pid=16471): Launched 06:14:28.112754 bus /sierra_2: Setting Powered False 06:14:29.175068 run create_hlr_db(pid=16471): Terminated: ok {rc=0} 06:14:29.630119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16473): Launched 06:14:29.965160 run osmo-hlr_10.42.42.2(pid=16474): Launched 06:14:30.092652 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:30.668882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16476): Launched 06:14:31.018684 run osmo-stp_10.42.42.5(pid=16477): Launched 06:14:31.271648 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:31.949610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16479): Launched 06:14:32.296475 run osmo-msc_10.42.42.6(pid=16480): Launched 06:14:32.480803 run osmo-stp_10.42.42.5(pid=16477): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16477)] 06:14:32.619441 run osmo-stp_10.42.42.5(pid=16477): stdout: | (launched: 2022-12-14_06:14:30.952804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:32.759457 run osmo-stp_10.42.42.5(pid=16477): stderr: | 20221214061431249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061431249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061431249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061431250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061431250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061431250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061431250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:32.898323 run osmo-stp_10.42.42.5(pid=16477): stdout: | (launched: 2022-12-14_06:14:30.952804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:33.030143 run osmo-stp_10.42.42.5(pid=16477): stderr: | 20221214061431249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061431249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061431249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061431250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061431250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061431250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061431250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:33.188140 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16477): Process ended prematurely: osmo-stp_10.42.42.5(pid=16477) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16477)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:14:33.197968 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 06:14:33.226060 run osmo-hlr_10.42.42.2(pid=16474): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16474)] 06:14:33.276544 run osmo-hlr_10.42.42.2(pid=16474): stdout: | (launched: 2022-12-14_06:14:29.903085) 06:14:33.329143 run osmo-hlr_10.42.42.2(pid=16474): stderr: | 20221214061430106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061430106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061430106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061430106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061430106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061430106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061430121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061430129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061430129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061430129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:33.401911 run osmo-msc_10.42.42.6(pid=16480): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16480)] 06:14:33.452127 run osmo-msc_10.42.42.6(pid=16480): stdout: | (launched: 2022-12-14_06:14:32.235560) 06:14:33.504196 run osmo-msc_10.42.42.6(pid=16480): stderr: | 20221214061432559 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061432559 DLGLOBAL DEBUG validating counter group 0x7f0962effc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061432559 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061432560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061432560 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061432560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061432562 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061432562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061432562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061432562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:33.556483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16473): Terminating (SIGTERM) 06:14:33.598585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16476): Terminating (SIGTERM) 06:14:33.641140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16479): Terminating (SIGTERM) 06:14:33.683494 --- ParallelTerminationStrategy: PID 16473 died... 06:14:33.703682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16473): Terminated: ok {rc=0} 06:14:33.750677 --- ParallelTerminationStrategy: PID 16476 died... 06:14:33.770440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16476): Terminated: ok {rc=0} 06:14:33.817272 --- ParallelTerminationStrategy: PID 16479 died... 06:14:33.837298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16479): Terminated: ok {rc=0} 06:14:33.927207 bus /sierra_3: Setting Powered False 06:14:35.028768 bus /sierra_3: Setting Powered False 06:14:36.146489 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:14:37.298900 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:37.311321 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:14:37.383422 tst mo_mt_call_osmux.py: using LAC 38966 06:14:37.513125 tst mo_mt_call_osmux.py: using RAC 206 06:14:37.646122 tst mo_mt_call_osmux.py: using CellId 38966 06:14:37.775774 tst mo_mt_call_osmux.py: using BVCI 38967 06:14:37.895765 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:37.907494 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:37.918995 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:37.930644 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:37.942139 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:14:37.953580 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:14:38.073791 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:14:38.196191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:38.681595 run create_hlr_db(pid=16482): Launched 06:14:38.800723 bus /sierra_2: Setting Powered False 06:14:39.862866 run create_hlr_db(pid=16482): Terminated: ok {rc=0} 06:14:40.319615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16484): Launched 06:14:40.653666 run osmo-hlr_10.42.42.2(pid=16485): Launched 06:14:40.781665 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:41.355311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16487): Launched 06:14:41.688553 run osmo-stp_10.42.42.5(pid=16488): Launched 06:14:41.814589 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:42.416864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16490): Launched 06:14:42.750570 run osmo-msc_10.42.42.6(pid=16491): Launched 06:14:42.934956 run osmo-stp_10.42.42.5(pid=16488): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16488)] 06:14:43.074012 run osmo-stp_10.42.42.5(pid=16488): stdout: | (launched: 2022-12-14_06:14:41.627645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:43.218988 run osmo-stp_10.42.42.5(pid=16488): stderr: | 20221214061441821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061441821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061441822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061441822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061441822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061441822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061441823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:43.357914 run osmo-stp_10.42.42.5(pid=16488): stdout: | (launched: 2022-12-14_06:14:41.627645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:43.489681 run osmo-stp_10.42.42.5(pid=16488): stderr: | 20221214061441821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061441821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061441822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061441822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061441822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061441822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061441823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:43.647652 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16488): Process ended prematurely: osmo-stp_10.42.42.5(pid=16488) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16488)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:14:43.657651 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:14:43.685526 run osmo-hlr_10.42.42.2(pid=16485): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16485)] 06:14:43.735977 run osmo-hlr_10.42.42.2(pid=16485): stdout: | (launched: 2022-12-14_06:14:40.592535) 06:14:43.788210 run osmo-hlr_10.42.42.2(pid=16485): stderr: | 20221214061440792 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061440792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061440792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061440792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061440792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061440792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061440808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061440816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061440817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061440817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:43.860876 run osmo-msc_10.42.42.6(pid=16491): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16491)] 06:14:43.911415 run osmo-msc_10.42.42.6(pid=16491): stdout: | (launched: 2022-12-14_06:14:42.689414) 06:14:43.963374 run osmo-msc_10.42.42.6(pid=16491): stderr: | 20221214061443018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061443018 DLGLOBAL DEBUG validating counter group 0x7f0668358c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061443018 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061443018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061443018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061443019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061443020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061443021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061443021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061443021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:44.015784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16484): Terminating (SIGTERM) 06:14:44.057916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16487): Terminating (SIGTERM) 06:14:44.100773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16490): Terminating (SIGTERM) 06:14:44.143966 --- ParallelTerminationStrategy: PID 16484 died... 06:14:44.164776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16484): Terminated: ok {rc=0} 06:14:44.211607 --- ParallelTerminationStrategy: PID 16487 died... 06:14:44.231254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16487): Terminated: ok {rc=0} 06:14:44.277733 --- ParallelTerminationStrategy: PID 16490 died... 06:14:44.297574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16490): Terminated: ok {rc=0} 06:14:44.386326 bus /sierra_3: Setting Powered False 06:14:45.484155 bus /sierra_3: Setting Powered False 06:14:46.602637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:14:47.858054 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:47.865139 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:14:47.899085 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:14:47.926678 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:14:47.984348 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:14:48.018564 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:14:48.045576 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:14:48.593847 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:14:48.646830 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:48.658471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:14:48.727778 tst mo_mt_call.py: using LAC 38967 06:14:48.849936 tst mo_mt_call.py: using RAC 207 06:14:48.972131 tst mo_mt_call.py: using CellId 38967 06:14:49.092832 tst mo_mt_call.py: using BVCI 38968 06:14:49.206177 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:49.217462 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:49.228479 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:49.239562 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:49.250982 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:49.262350 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:14:49.383971 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:14:49.504851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:50.020069 run create_hlr_db(pid=16497): Launched 06:14:50.154671 bus /sierra_2: Setting Powered False 06:14:51.221184 run create_hlr_db(pid=16497): Terminated: ok {rc=0} 06:14:51.666869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16499): Launched 06:14:51.981358 run osmo-hlr_10.42.42.2(pid=16500): Launched 06:14:52.100210 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:52.639362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16502): Launched 06:14:52.952775 run osmo-stp_10.42.42.5(pid=16503): Launched 06:14:53.071825 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:53.635749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16505): Launched 06:14:53.949303 run osmo-msc_10.42.42.6(pid=16506): Launched 06:14:54.123409 run osmo-stp_10.42.42.5(pid=16503): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16503)] 06:14:54.256525 run osmo-stp_10.42.42.5(pid=16503): stdout: | (launched: 2022-12-14_06:14:52.894545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:54.388783 run osmo-stp_10.42.42.5(pid=16503): stderr: | 20221214061453067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061453067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061453068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061453068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061453068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061453069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061453069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:54.518498 run osmo-stp_10.42.42.5(pid=16503): stdout: | (launched: 2022-12-14_06:14:52.894545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:54.642807 run osmo-stp_10.42.42.5(pid=16503): stderr: | 20221214061453067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061453067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061453068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061453068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061453068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061453069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061453069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:54.791370 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16503): Process ended prematurely: osmo-stp_10.42.42.5(pid=16503) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16503)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:14:54.800643 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:14:54.827156 run osmo-hlr_10.42.42.2(pid=16500): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16500)] 06:14:54.875865 run osmo-hlr_10.42.42.2(pid=16500): stdout: | (launched: 2022-12-14_06:14:51.923440) 06:14:54.925973 run osmo-hlr_10.42.42.2(pid=16500): stderr: | 20221214061452102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061452102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061452102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061452102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061452102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061452102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061452139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061452148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061452149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061452149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:54.995945 run osmo-msc_10.42.42.6(pid=16506): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16506)] 06:14:55.043852 run osmo-msc_10.42.42.6(pid=16506): stdout: | (launched: 2022-12-14_06:14:53.891574) 06:14:55.094037 run osmo-msc_10.42.42.6(pid=16506): stderr: | 20221214061454165 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061454165 DLGLOBAL DEBUG validating counter group 0x7f1c380e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061454166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061454166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061454166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061454166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061454168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061454168 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061454168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061454168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:55.144522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16499): Terminating (SIGTERM) 06:14:55.185166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16502): Terminating (SIGTERM) 06:14:55.225484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16505): Terminating (SIGTERM) 06:14:55.265765 --- ParallelTerminationStrategy: PID 16499 died... 06:14:55.285556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16499): Terminated: ok {rc=0} 06:14:55.330256 --- ParallelTerminationStrategy: PID 16502 died... 06:14:55.349505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16502): Terminated: ok {rc=0} 06:14:55.393871 --- ParallelTerminationStrategy: PID 16505 died... 06:14:55.413246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16505): Terminated: ok {rc=0} 06:14:55.500520 bus /sierra_3: Setting Powered False 06:14:56.601334 bus /sierra_3: Setting Powered False 06:14:57.719695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:14:58.871083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:58.883354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:14:58.959084 tst mo_mt_call_osmux.py: using LAC 38968 06:14:59.087772 tst mo_mt_call_osmux.py: using RAC 208 06:14:59.210134 tst mo_mt_call_osmux.py: using CellId 38968 06:14:59.331519 tst mo_mt_call_osmux.py: using BVCI 38969 06:14:59.444184 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:59.455459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:59.466559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:59.477700 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:59.489093 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:59.500335 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:14:59.621725 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:14:59.740719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:00.226396 run create_hlr_db(pid=16508): Launched 06:15:00.346053 bus /sierra_2: Setting Powered False 06:15:01.426363 run create_hlr_db(pid=16508): Terminated: ok {rc=0} 06:15:01.921228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Launched 06:15:02.271952 run osmo-hlr_10.42.42.2(pid=16514): Launched 06:15:02.400445 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:02.976381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Launched 06:15:03.309567 run osmo-stp_10.42.42.5(pid=16517): Launched 06:15:03.435635 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:04.036406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16519): Launched 06:15:04.369625 run osmo-msc_10.42.42.6(pid=16520): Launched 06:15:04.554605 run osmo-stp_10.42.42.5(pid=16517): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] 06:15:04.694335 run osmo-stp_10.42.42.5(pid=16517): stdout: | (launched: 2022-12-14_06:15:03.248709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:04.834646 run osmo-stp_10.42.42.5(pid=16517): stderr: | 20221214061503442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061503443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061503443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061503443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061503444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061503444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061503444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:04.973310 run osmo-stp_10.42.42.5(pid=16517): stdout: | (launched: 2022-12-14_06:15:03.248709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:05.105144 run osmo-stp_10.42.42.5(pid=16517): stderr: | 20221214061503442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061503443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061503443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061503443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061503444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061503444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061503444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:05.263679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16517): Process ended prematurely: osmo-stp_10.42.42.5(pid=16517) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:15:05.273475 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:15:05.301395 run osmo-hlr_10.42.42.2(pid=16514): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16514)] 06:15:05.353110 run osmo-hlr_10.42.42.2(pid=16514): stdout: | (launched: 2022-12-14_06:15:02.210556) 06:15:05.405938 run osmo-hlr_10.42.42.2(pid=16514): stderr: | 20221214061502408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061502408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061502408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061502408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061502409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061502409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061502421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061502431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061502431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061502431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:05.479863 run osmo-msc_10.42.42.6(pid=16520): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16520)] 06:15:05.530343 run osmo-msc_10.42.42.6(pid=16520): stdout: | (launched: 2022-12-14_06:15:04.308288) 06:15:05.583003 run osmo-msc_10.42.42.6(pid=16520): stderr: | 20221214061504632 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061504632 DLGLOBAL DEBUG validating counter group 0x7efd28b23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061504632 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061504632 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061504632 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061504633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061504634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061504635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061504635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061504635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:05.636008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Terminating (SIGTERM) 06:15:05.678730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Terminating (SIGTERM) 06:15:05.721678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16519): Terminating (SIGTERM) 06:15:05.764674 --- ParallelTerminationStrategy: PID 16513 died... 06:15:05.785892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Terminated: ok {rc=0} 06:15:05.833174 --- ParallelTerminationStrategy: PID 16516 died... 06:15:05.853530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Terminated: ok {rc=0} 06:15:05.900736 --- ParallelTerminationStrategy: PID 16519 died... 06:15:05.921157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16519): Terminated: ok {rc=0} 06:15:06.011427 bus /sierra_3: Setting Powered False 06:15:07.111079 bus /sierra_3: Setting Powered False 06:15:08.238238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:15:09.485273 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:09.493813 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:15:09.528090 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:15:09.555511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:15:09.608440 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:15:09.642763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:15:09.670073 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:15:10.218738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:15:10.269514 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:10.280546 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:15:10.349821 tst mo_mt_call.py: using LAC 38969 06:15:10.481534 tst mo_mt_call.py: using RAC 209 06:15:10.611420 tst mo_mt_call.py: using CellId 38969 06:15:10.740830 tst mo_mt_call.py: using BVCI 38970 06:15:10.861135 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:10.872806 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:10.884228 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:10.895905 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:10.907397 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:10.918734 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:15:11.036339 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:15:11.155712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:11.642196 run create_hlr_db(pid=16526): Launched 06:15:11.762545 bus /sierra_2: Setting Powered False 06:15:12.824742 run create_hlr_db(pid=16526): Terminated: ok {rc=0} 06:15:13.273226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16528): Launched 06:15:13.587849 run osmo-hlr_10.42.42.2(pid=16529): Launched 06:15:13.707594 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:14.258875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16531): Launched 06:15:14.574198 run osmo-stp_10.42.42.5(pid=16532): Launched 06:15:14.693806 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:15.260212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16534): Launched 06:15:15.574219 run osmo-msc_10.42.42.6(pid=16535): Launched 06:15:15.748675 run osmo-stp_10.42.42.5(pid=16532): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16532)] 06:15:15.979059 run osmo-stp_10.42.42.5(pid=16532): stdout: | (launched: 2022-12-14_06:15:14.516140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:16.129222 run osmo-stp_10.42.42.5(pid=16532): stderr: | 20221214061514688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061514688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061514689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061514689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061514690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061514690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061514690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:16.270407 run osmo-stp_10.42.42.5(pid=16532): stdout: | (launched: 2022-12-14_06:15:14.516140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:16.408640 run osmo-stp_10.42.42.5(pid=16532): stderr: | 20221214061514688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061514688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061514689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061514689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061514690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061514690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061514690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:16.572042 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16532): Process ended prematurely: osmo-stp_10.42.42.5(pid=16532) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16532)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:15:16.583759 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:15:16.613600 run osmo-hlr_10.42.42.2(pid=16529): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16529)] 06:15:16.667941 run osmo-hlr_10.42.42.2(pid=16529): stdout: | (launched: 2022-12-14_06:15:13.530309) 06:15:16.723605 run osmo-hlr_10.42.42.2(pid=16529): stderr: | 20221214061513708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061513708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061513708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061513708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061513708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061513708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061513720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061513728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061513728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061513728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:16.799056 run osmo-msc_10.42.42.6(pid=16535): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16535)] 06:15:16.852054 run osmo-msc_10.42.42.6(pid=16535): stdout: | (launched: 2022-12-14_06:15:15.516526) 06:15:16.908272 run osmo-msc_10.42.42.6(pid=16535): stderr: | 20221214061515788 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061515788 DLGLOBAL DEBUG validating counter group 0x7f6baa9f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061515789 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061515789 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061515789 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061515789 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061515791 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061515791 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061515791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061515791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:16.963340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16528): Terminating (SIGTERM) 06:15:17.008250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16531): Terminating (SIGTERM) 06:15:17.054950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16534): Terminating (SIGTERM) 06:15:17.103081 --- ParallelTerminationStrategy: PID 16528 died... 06:15:17.125017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16528): Terminated: ok {rc=0} 06:15:17.174821 --- ParallelTerminationStrategy: PID 16531 died... 06:15:17.196822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16531): Terminated: ok {rc=0} 06:15:17.242518 --- ParallelTerminationStrategy: PID 16534 died... 06:15:17.262470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16534): Terminated: ok {rc=0} 06:15:17.350548 bus /sierra_3: Setting Powered False 06:15:18.451169 bus /sierra_3: Setting Powered False 06:15:19.565586 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:15:20.711473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:20.723532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:15:20.798306 tst mo_mt_call_osmux.py: using LAC 38970 06:15:20.919951 tst mo_mt_call_osmux.py: using RAC 210 06:15:21.039976 tst mo_mt_call_osmux.py: using CellId 38970 06:15:21.161155 tst mo_mt_call_osmux.py: using BVCI 38971 06:15:21.274227 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:21.285666 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:21.296771 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:21.307943 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:21.319515 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:15:21.330952 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:15:21.453738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:15:21.576797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:22.093291 run create_hlr_db(pid=16537): Launched 06:15:22.228083 bus /sierra_2: Setting Powered False 06:15:23.293805 run create_hlr_db(pid=16537): Terminated: ok {rc=0} 06:15:23.738835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16539): Launched 06:15:24.052819 run osmo-hlr_10.42.42.2(pid=16540): Launched 06:15:24.173740 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:24.726589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16542): Launched 06:15:25.039208 run osmo-stp_10.42.42.5(pid=16543): Launched 06:15:25.158004 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:25.723254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16545): Launched 06:15:26.036232 run osmo-msc_10.42.42.6(pid=16546): Launched 06:15:26.210909 run osmo-stp_10.42.42.5(pid=16543): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16543)] 06:15:26.350005 run osmo-stp_10.42.42.5(pid=16543): stdout: | (launched: 2022-12-14_06:15:24.981574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:26.492318 run osmo-stp_10.42.42.5(pid=16543): stderr: | 20221214061525155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061525155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061525155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061525155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061525156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061525156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061525156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:26.631581 run osmo-stp_10.42.42.5(pid=16543): stdout: | (launched: 2022-12-14_06:15:24.981574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:26.763943 run osmo-stp_10.42.42.5(pid=16543): stderr: | 20221214061525155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061525155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061525155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061525155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061525156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061525156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061525156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:26.922567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16543): Process ended prematurely: osmo-stp_10.42.42.5(pid=16543) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16543)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:15:26.932245 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:15:26.960486 run osmo-hlr_10.42.42.2(pid=16540): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16540)] 06:15:27.013409 run osmo-hlr_10.42.42.2(pid=16540): stdout: | (launched: 2022-12-14_06:15:23.995111) 06:15:27.066667 run osmo-hlr_10.42.42.2(pid=16540): stderr: | 20221214061524173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061524173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061524173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061524173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061524173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061524173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061524186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061524194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061524194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061524194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:27.140715 run osmo-msc_10.42.42.6(pid=16546): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16546)] 06:15:27.192208 run osmo-msc_10.42.42.6(pid=16546): stdout: | (launched: 2022-12-14_06:15:25.978466) 06:15:27.245993 run osmo-msc_10.42.42.6(pid=16546): stderr: | 20221214061526250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061526250 DLGLOBAL DEBUG validating counter group 0x7fd110bfec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061526251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061526251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061526251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061526252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061526254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061526255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061526255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061526255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:27.298897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16539): Terminating (SIGTERM) 06:15:27.341841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16542): Terminating (SIGTERM) 06:15:27.384785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16545): Terminating (SIGTERM) 06:15:27.428195 --- ParallelTerminationStrategy: PID 16539 died... 06:15:27.449302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16539): Terminated: ok {rc=0} 06:15:27.496877 --- ParallelTerminationStrategy: PID 16542 died... 06:15:27.517579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16542): Terminated: ok {rc=0} 06:15:27.564819 --- ParallelTerminationStrategy: PID 16545 died... 06:15:27.585704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16545): Terminated: ok {rc=0} 06:15:27.675773 bus /sierra_3: Setting Powered False 06:15:28.774896 bus /sierra_3: Setting Powered False 06:15:29.890904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:15:31.174278 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:31.183947 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:15:31.228532 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:15:31.262970 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:15:31.328272 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:15:31.369515 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:15:31.401820 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:15:31.947328 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:15:32.002674 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:32.015337 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:15:32.086281 tst mo_mt_call.py: using LAC 38971 06:15:32.238374 tst mo_mt_call.py: using RAC 211 06:15:32.360856 tst mo_mt_call.py: using CellId 38971 06:15:32.480902 tst mo_mt_call.py: using BVCI 38972 06:15:32.594980 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:32.606271 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:32.617412 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:32.628330 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:32.639810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:32.651217 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:15:32.772218 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:15:32.893197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:33.410101 run create_hlr_db(pid=16551): Launched 06:15:33.546264 bus /sierra_2: Setting Powered False 06:15:34.611852 run create_hlr_db(pid=16551): Terminated: ok {rc=0} 06:15:35.057149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16553): Launched 06:15:35.370826 run osmo-hlr_10.42.42.2(pid=16554): Launched 06:15:35.489754 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:36.040268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16556): Launched 06:15:36.352266 run osmo-stp_10.42.42.5(pid=16557): Launched 06:15:36.471151 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:37.034992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16559): Launched 06:15:37.348335 run osmo-msc_10.42.42.6(pid=16560): Launched 06:15:37.524137 run osmo-stp_10.42.42.5(pid=16557): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16557)] 06:15:37.656208 run osmo-stp_10.42.42.5(pid=16557): stdout: | (launched: 2022-12-14_06:15:36.294753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:37.787970 run osmo-stp_10.42.42.5(pid=16557): stderr: | 20221214061536466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061536466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061536466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061536467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061536467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061536467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061536467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:37.918244 run osmo-stp_10.42.42.5(pid=16557): stdout: | (launched: 2022-12-14_06:15:36.294753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:38.042383 run osmo-stp_10.42.42.5(pid=16557): stderr: | 20221214061536466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061536466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061536466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061536467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061536467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061536467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061536467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:38.190990 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16557): Process ended prematurely: osmo-stp_10.42.42.5(pid=16557) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16557)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:15:38.200174 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:15:38.227140 run osmo-hlr_10.42.42.2(pid=16554): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16554)] 06:15:38.276711 run osmo-hlr_10.42.42.2(pid=16554): stdout: | (launched: 2022-12-14_06:15:35.313295) 06:15:38.326992 run osmo-hlr_10.42.42.2(pid=16554): stderr: | 20221214061535490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061535490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061535491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061535491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061535491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061535491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061535503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061535514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061535514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061535514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:38.397422 run osmo-msc_10.42.42.6(pid=16560): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16560)] 06:15:38.445707 run osmo-msc_10.42.42.6(pid=16560): stdout: | (launched: 2022-12-14_06:15:37.290652) 06:15:38.495905 run osmo-msc_10.42.42.6(pid=16560): stderr: | 20221214061537563 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061537563 DLGLOBAL DEBUG validating counter group 0x7fe36c289c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061537564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061537564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061537564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061537564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061537566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061537566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061537566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061537566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:38.546587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16553): Terminating (SIGTERM) 06:15:38.587304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16556): Terminating (SIGTERM) 06:15:38.627659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16559): Terminating (SIGTERM) 06:15:38.668276 --- ParallelTerminationStrategy: PID 16553 died... 06:15:38.688054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16553): Terminated: ok {rc=0} 06:15:38.732764 --- ParallelTerminationStrategy: PID 16556 died... 06:15:38.752073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16556): Terminated: ok {rc=0} 06:15:38.797149 --- ParallelTerminationStrategy: PID 16559 died... 06:15:38.816547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16559): Terminated: ok {rc=0} 06:15:38.902023 bus /sierra_3: Setting Powered False 06:15:40.001377 bus /sierra_3: Setting Powered False 06:15:41.119317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:15:42.267197 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:42.279369 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:15:42.349114 tst mo_mt_call_osmux.py: using LAC 38972 06:15:42.472273 tst mo_mt_call_osmux.py: using RAC 212 06:15:42.595148 tst mo_mt_call_osmux.py: using CellId 38972 06:15:42.718108 tst mo_mt_call_osmux.py: using BVCI 38973 06:15:42.833104 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:42.844375 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:42.855287 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:42.866449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:42.877573 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:15:42.888852 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:15:43.006646 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:15:43.128908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:43.645993 run create_hlr_db(pid=16562): Launched 06:15:43.781078 bus /sierra_2: Setting Powered False 06:15:44.846771 run create_hlr_db(pid=16562): Terminated: ok {rc=0} 06:15:45.294202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16564): Launched 06:15:45.608803 run osmo-hlr_10.42.42.2(pid=16565): Launched 06:15:45.729297 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:46.307476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16567): Launched 06:15:46.641785 run osmo-stp_10.42.42.5(pid=16568): Launched 06:15:46.802831 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:47.549378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16570): Launched 06:15:47.884474 run osmo-msc_10.42.42.6(pid=16571): Launched 06:15:48.069337 run osmo-stp_10.42.42.5(pid=16568): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16568)] 06:15:48.209988 run osmo-stp_10.42.42.5(pid=16568): stdout: | (launched: 2022-12-14_06:15:46.578996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:48.350835 run osmo-stp_10.42.42.5(pid=16568): stderr: | 20221214061546917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061546917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061546917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061546918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061546918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061546918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061546918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:48.489789 run osmo-stp_10.42.42.5(pid=16568): stdout: | (launched: 2022-12-14_06:15:46.578996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:48.622580 run osmo-stp_10.42.42.5(pid=16568): stderr: | 20221214061546917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061546917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061546917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061546918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061546918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061546918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061546918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:48.781727 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16568): Process ended prematurely: osmo-stp_10.42.42.5(pid=16568) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16568)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:15:48.791624 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 06:15:48.820036 run osmo-hlr_10.42.42.2(pid=16565): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16565)] 06:15:48.870873 run osmo-hlr_10.42.42.2(pid=16565): stdout: | (launched: 2022-12-14_06:15:45.550856) 06:15:48.923695 run osmo-hlr_10.42.42.2(pid=16565): stderr: | 20221214061545729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061545729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061545729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061545729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061545729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061545729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061545741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061545750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061545751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061545751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:48.997274 run osmo-msc_10.42.42.6(pid=16571): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16571)] 06:15:49.048014 run osmo-msc_10.42.42.6(pid=16571): stdout: | (launched: 2022-12-14_06:15:47.822448) 06:15:49.100532 run osmo-msc_10.42.42.6(pid=16571): stderr: | 20221214061548146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061548146 DLGLOBAL DEBUG validating counter group 0x7f7959b9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061548146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061548146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061548147 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061548147 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061548148 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061548149 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061548149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061548149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:49.153612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16564): Terminating (SIGTERM) 06:15:49.196230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16567): Terminating (SIGTERM) 06:15:49.238809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16570): Terminating (SIGTERM) 06:15:49.281669 --- ParallelTerminationStrategy: PID 16564 died... 06:15:49.302297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16564): Terminated: ok {rc=0} 06:15:49.349584 --- ParallelTerminationStrategy: PID 16567 died... 06:15:49.369727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16567): Terminated: ok {rc=0} 06:15:49.416641 --- ParallelTerminationStrategy: PID 16570 died... 06:15:49.436801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16570): Terminated: ok {rc=0} 06:15:49.525768 bus /sierra_3: Setting Powered False 06:15:50.625830 bus /sierra_3: Setting Powered False 06:15:51.742860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:15:53.004407 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:53.011660 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:15:53.045498 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:15:53.073613 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:15:53.126370 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:15:53.160254 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:15:53.187218 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:15:53.735223 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:15:53.785839 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:53.797083 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:15:53.866014 tst mo_mt_call.py: using LAC 38973 06:15:53.993971 tst mo_mt_call.py: using RAC 213 06:15:54.115661 tst mo_mt_call.py: using CellId 38973 06:15:54.246885 tst mo_mt_call.py: using BVCI 38974 06:15:54.367389 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:54.378973 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:54.390388 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:54.401709 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:54.413371 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:54.424683 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:15:54.543553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:15:54.664751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:55.180581 run create_hlr_db(pid=16576): Launched 06:15:55.314853 bus /sierra_2: Setting Powered False 06:15:56.380457 run create_hlr_db(pid=16576): Terminated: ok {rc=0} 06:15:56.826683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16578): Launched 06:15:57.140921 run osmo-hlr_10.42.42.2(pid=16579): Launched 06:15:57.259867 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:57.810358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16581): Launched 06:15:58.123655 run osmo-stp_10.42.42.5(pid=16582): Launched 06:15:58.242378 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:58.806663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16584): Launched 06:15:59.119218 run osmo-msc_10.42.42.6(pid=16585): Launched 06:15:59.294025 run osmo-stp_10.42.42.5(pid=16582): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16582)] 06:15:59.426778 run osmo-stp_10.42.42.5(pid=16582): stdout: | (launched: 2022-12-14_06:15:58.065307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:59.558349 run osmo-stp_10.42.42.5(pid=16582): stderr: | 20221214061558236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061558236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061558236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061558237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061558237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061558237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061558237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:59.688008 run osmo-stp_10.42.42.5(pid=16582): stdout: | (launched: 2022-12-14_06:15:58.065307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:59.811912 run osmo-stp_10.42.42.5(pid=16582): stderr: | 20221214061558236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061558236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061558236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061558237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061558237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061558237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061558237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:59.960348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16582): Process ended prematurely: osmo-stp_10.42.42.5(pid=16582) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16582)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:15:59.969462 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:15:59.995935 run osmo-hlr_10.42.42.2(pid=16579): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16579)] 06:16:00.044627 run osmo-hlr_10.42.42.2(pid=16579): stdout: | (launched: 2022-12-14_06:15:57.083189) 06:16:00.094703 run osmo-hlr_10.42.42.2(pid=16579): stderr: | 20221214061557261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061557261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061557261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061557261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061557261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061557261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061557274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061557282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061557284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061557284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:00.164462 run osmo-msc_10.42.42.6(pid=16585): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16585)] 06:16:00.212447 run osmo-msc_10.42.42.6(pid=16585): stdout: | (launched: 2022-12-14_06:15:59.061651) 06:16:00.262649 run osmo-msc_10.42.42.6(pid=16585): stderr: | 20221214061559333 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061559333 DLGLOBAL DEBUG validating counter group 0x7f8dc3fc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061559333 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061559333 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061559333 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061559333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061559335 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061559335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061559336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061559336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:00.313450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16578): Terminating (SIGTERM) 06:16:00.353644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16581): Terminating (SIGTERM) 06:16:00.393883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16584): Terminating (SIGTERM) 06:16:00.434165 --- ParallelTerminationStrategy: PID 16578 died... 06:16:00.453768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16578): Terminated: ok {rc=0} 06:16:00.498409 --- ParallelTerminationStrategy: PID 16581 died... 06:16:00.517620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16581): Terminated: ok {rc=0} 06:16:00.562269 --- ParallelTerminationStrategy: PID 16584 died... 06:16:00.581397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16584): Terminated: ok {rc=0} 06:16:00.668672 bus /sierra_3: Setting Powered False 06:16:01.775557 bus /sierra_3: Setting Powered False 06:16:02.906436 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:16:04.060052 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:16:04.072445 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:16:04.143747 tst mo_mt_call_osmux.py: using LAC 38974 06:16:04.267089 tst mo_mt_call_osmux.py: using RAC 214 06:16:04.390525 tst mo_mt_call_osmux.py: using CellId 38974 06:16:04.513394 tst mo_mt_call_osmux.py: using BVCI 38975 06:16:04.626560 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:16:04.637762 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:16:04.648652 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:16:04.659616 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:16:04.670952 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:16:04.682266 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:16:04.804281 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:16:04.923070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:05.407301 run create_hlr_db(pid=16587): Launched 06:16:05.525487 bus /sierra_2: Setting Powered False 06:16:06.587712 run create_hlr_db(pid=16587): Terminated: ok {rc=0} 06:16:07.022801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16589): Launched 06:16:07.336252 run osmo-hlr_10.42.42.2(pid=16590): Launched 06:16:07.455779 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:08.004700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16592): Launched 06:16:08.321861 run osmo-stp_10.42.42.5(pid=16593): Launched 06:16:08.441358 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:09.008278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16595): Launched 06:16:09.321742 run osmo-msc_10.42.42.6(pid=16596): Launched 06:16:09.496363 run osmo-stp_10.42.42.5(pid=16593): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16593)] 06:16:09.628841 run osmo-stp_10.42.42.5(pid=16593): stdout: | (launched: 2022-12-14_06:16:08.260199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:09.760603 run osmo-stp_10.42.42.5(pid=16593): stderr: | 20221214061608430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061608430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061608431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061608431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061608431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061608432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061608432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:09.890571 run osmo-stp_10.42.42.5(pid=16593): stdout: | (launched: 2022-12-14_06:16:08.260199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:10.014300 run osmo-stp_10.42.42.5(pid=16593): stderr: | 20221214061608430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061608430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061608431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061608431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061608431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061608432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061608432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:10.162643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16593): Process ended prematurely: osmo-stp_10.42.42.5(pid=16593) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16593)] [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:16:10.171699 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:16:10.198320 run osmo-hlr_10.42.42.2(pid=16590): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16590)] 06:16:10.247219 run osmo-hlr_10.42.42.2(pid=16590): stdout: | (launched: 2022-12-14_06:16:07.278792) 06:16:10.297283 run osmo-hlr_10.42.42.2(pid=16590): stderr: | 20221214061607456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061607456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061607456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061607456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061607456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061607456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061607468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061607476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061607476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061607476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:10.367657 run osmo-msc_10.42.42.6(pid=16596): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16596)] 06:16:10.415937 run osmo-msc_10.42.42.6(pid=16596): stdout: | (launched: 2022-12-14_06:16:09.263943) 06:16:10.466014 run osmo-msc_10.42.42.6(pid=16596): stderr: | 20221214061609537 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061609537 DLGLOBAL DEBUG validating counter group 0x7fa7b4445c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061609538 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061609538 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061609538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061609538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061609540 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061609540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061609540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061609540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:10.516575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16589): Terminating (SIGTERM) 06:16:10.556935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16592): Terminating (SIGTERM) 06:16:10.597124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16595): Terminating (SIGTERM) 06:16:10.638139 --- ParallelTerminationStrategy: PID 16589 died... 06:16:10.657761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16589): Terminated: ok {rc=0} 06:16:10.702328 --- ParallelTerminationStrategy: PID 16592 died... 06:16:10.721506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16592): Terminated: ok {rc=0} 06:16:10.765796 --- ParallelTerminationStrategy: PID 16595 died... 06:16:10.784649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16595): Terminated: ok {rc=0} 06:16:10.872101 bus /sierra_3: Setting Powered False 06:16:11.973119 bus /sierra_3: Setting Powered False 06:16:13.088737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:16:14.343354 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:16:14.350250 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:16:14.383524 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:16:14.411388 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:16:14.461656 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:16:14.494478 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:16:14.521216 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:16:15.074140 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:16:15.125794 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:15.137213 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:16:15.204833 tst mo_mt_call.py: using LAC 38975 06:16:15.324713 tst mo_mt_call.py: using RAC 215 06:16:15.444784 tst mo_mt_call.py: using CellId 38975 06:16:15.564465 tst mo_mt_call.py: using BVCI 38976 06:16:15.677840 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:15.689275 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:15.700286 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:15.711529 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:15.723049 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:15.734520 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:16:15.860908 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:16:15.988125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:16.567805 run create_hlr_db(pid=16601): Launched 06:16:16.727266 bus /sierra_2: Setting Powered False 06:16:17.792392 run create_hlr_db(pid=16601): Terminated: ok {rc=0} 06:16:18.238356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16603): Launched 06:16:18.553240 run osmo-hlr_10.42.42.2(pid=16604): Launched 06:16:18.673020 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:19.213130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16606): Launched 06:16:19.526865 run osmo-stp_10.42.42.5(pid=16607): Launched 06:16:19.645599 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:20.209503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16609): Launched 06:16:20.521303 run osmo-msc_10.42.42.6(pid=16610): Launched 06:16:20.696534 run osmo-stp_10.42.42.5(pid=16607): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16607)] 06:16:20.828794 run osmo-stp_10.42.42.5(pid=16607): stdout: | (launched: 2022-12-14_06:16:19.468744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:20.961274 run osmo-stp_10.42.42.5(pid=16607): stderr: | 20221214061619641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061619641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061619641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061619642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061619642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061619642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061619642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:21.090713 run osmo-stp_10.42.42.5(pid=16607): stdout: | (launched: 2022-12-14_06:16:19.468744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:21.215152 run osmo-stp_10.42.42.5(pid=16607): stderr: | 20221214061619641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061619641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061619641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061619642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061619642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061619642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061619642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:21.363707 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16607): Process ended prematurely: osmo-stp_10.42.42.5(pid=16607) [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16607)] [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:16:21.373052 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:16:21.399805 run osmo-hlr_10.42.42.2(pid=16604): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16604)] 06:16:21.448464 run osmo-hlr_10.42.42.2(pid=16604): stdout: | (launched: 2022-12-14_06:16:18.495494) 06:16:21.498391 run osmo-hlr_10.42.42.2(pid=16604): stderr: | 20221214061618672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061618672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061618672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061618672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061618672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061618672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061618685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061618694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061618694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061618695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:21.568111 run osmo-msc_10.42.42.6(pid=16610): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16610)] 06:16:21.615762 run osmo-msc_10.42.42.6(pid=16610): stdout: | (launched: 2022-12-14_06:16:20.463877) 06:16:21.665461 run osmo-msc_10.42.42.6(pid=16610): stderr: | 20221214061620736 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061620737 DLGLOBAL DEBUG validating counter group 0x7effb0e3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061620737 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061620737 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061620737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061620737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061620739 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061620739 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061620739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061620740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:21.715684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16603): Terminating (SIGTERM) 06:16:21.755743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16606): Terminating (SIGTERM) 06:16:21.795824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16609): Terminating (SIGTERM) 06:16:21.836023 --- ParallelTerminationStrategy: PID 16603 died... 06:16:21.855755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16603): Terminated: ok {rc=0} 06:16:21.900497 --- ParallelTerminationStrategy: PID 16606 died... 06:16:21.920612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16606): Terminated: ok {rc=0} 06:16:21.966458 --- ParallelTerminationStrategy: PID 16609 died... 06:16:21.985533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16609): Terminated: ok {rc=0} 06:16:22.071200 bus /sierra_3: Setting Powered False 06:16:23.171522 bus /sierra_3: Setting Powered False 06:16:24.288766 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:16:25.438037 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:25.450295 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:16:25.521619 tst mo_mt_call_osmux.py: using LAC 38976 06:16:25.651678 tst mo_mt_call_osmux.py: using RAC 216 06:16:25.773738 tst mo_mt_call_osmux.py: using CellId 38976 06:16:25.897409 tst mo_mt_call_osmux.py: using BVCI 38977 06:16:26.010632 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:26.022216 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:26.033562 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:26.044656 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:26.056112 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:16:26.067474 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:16:26.189480 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:16:26.308769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:26.795829 run create_hlr_db(pid=16612): Launched 06:16:26.915327 bus /sierra_2: Setting Powered False 06:16:27.980439 run create_hlr_db(pid=16612): Terminated: ok {rc=0} 06:16:28.427588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16614): Launched 06:16:28.762436 run osmo-hlr_10.42.42.2(pid=16615): Launched 06:16:28.887997 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:29.462206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16617): Launched 06:16:29.795336 run osmo-stp_10.42.42.5(pid=16618): Launched 06:16:29.921295 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:30.528156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16620): Launched 06:16:30.861702 run osmo-msc_10.42.42.6(pid=16621): Launched 06:16:31.156672 run osmo-stp_10.42.42.5(pid=16618): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16618)] 06:16:31.424405 run osmo-stp_10.42.42.5(pid=16618): stdout: | (launched: 2022-12-14_06:16:29.734284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:31.675311 run osmo-stp_10.42.42.5(pid=16618): stderr: | 20221214061629928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061629928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061629929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061629929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061629929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061629930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061629930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:31.875953 run osmo-stp_10.42.42.5(pid=16618): stdout: | (launched: 2022-12-14_06:16:29.734284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:32.018675 run osmo-stp_10.42.42.5(pid=16618): stderr: | 20221214061629928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061629928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061629929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061629929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061629929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061629930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061629930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:32.175975 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16618): Process ended prematurely: osmo-stp_10.42.42.5(pid=16618) [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16618)] [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:16:32.186120 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 06:16:32.214213 run osmo-hlr_10.42.42.2(pid=16615): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16615)] 06:16:32.266229 run osmo-hlr_10.42.42.2(pid=16615): stdout: | (launched: 2022-12-14_06:16:28.701402) 06:16:32.320763 run osmo-hlr_10.42.42.2(pid=16615): stderr: | 20221214061628903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061628903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061628903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061628903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061628903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061628903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061628915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061628923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061628923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061628923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:32.393678 run osmo-msc_10.42.42.6(pid=16621): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16621)] 06:16:32.442577 run osmo-msc_10.42.42.6(pid=16621): stdout: | (launched: 2022-12-14_06:16:30.800491) 06:16:32.492771 run osmo-msc_10.42.42.6(pid=16621): stderr: | 20221214061631309 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061631309 DLGLOBAL DEBUG validating counter group 0x7f19418a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061631309 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061631309 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061631309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061631309 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061631311 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061631311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061631312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061631312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:32.543276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16614): Terminating (SIGTERM) 06:16:32.584088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16617): Terminating (SIGTERM) 06:16:32.624937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16620): Terminating (SIGTERM) 06:16:32.666151 --- ParallelTerminationStrategy: PID 16614 died... 06:16:32.685762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16614): Terminated: ok {rc=0} 06:16:32.730574 --- ParallelTerminationStrategy: PID 16617 died... 06:16:32.749770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16617): Terminated: ok {rc=0} 06:16:32.794280 --- ParallelTerminationStrategy: PID 16620 died... 06:16:32.813564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16620): Terminated: ok {rc=0} 06:16:32.900824 bus /sierra_3: Setting Powered False 06:16:34.000347 bus /sierra_3: Setting Powered False 06:16:35.115518 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:16:36.369287 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:16:36.375751 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:16:36.409601 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:16:36.437350 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:16:36.491177 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:16:36.525382 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:16:36.552582 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:16:37.101882 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:16:37.155572 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:37.167137 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:16:37.239776 tst mo_mt_call.py: using LAC 38977 06:16:37.369762 tst mo_mt_call.py: using RAC 217 06:16:37.499236 tst mo_mt_call.py: using CellId 38977 06:16:37.631415 tst mo_mt_call.py: using BVCI 38978 06:16:37.753941 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:37.765406 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:37.776499 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:37.787709 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:37.798952 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:37.810443 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:16:37.928263 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:16:38.049884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:38.567550 run create_hlr_db(pid=16626): Launched 06:16:38.701483 bus /sierra_2: Setting Powered False 06:16:39.766928 run create_hlr_db(pid=16626): Terminated: ok {rc=0} 06:16:40.213761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16628): Launched 06:16:40.527527 run osmo-hlr_10.42.42.2(pid=16629): Launched 06:16:40.647159 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:41.202541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16631): Launched 06:16:41.517060 run osmo-stp_10.42.42.5(pid=16632): Launched 06:16:41.638038 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:42.205672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16634): Launched 06:16:42.519239 run osmo-msc_10.42.42.6(pid=16635): Launched 06:16:42.699061 run osmo-stp_10.42.42.5(pid=16632): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16632)] 06:16:42.833267 run osmo-stp_10.42.42.5(pid=16632): stdout: | (launched: 2022-12-14_06:16:41.458739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:42.965747 run osmo-stp_10.42.42.5(pid=16632): stderr: | 20221214061641630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061641631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061641631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061641631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061641632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061641632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061641632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:43.097130 run osmo-stp_10.42.42.5(pid=16632): stdout: | (launched: 2022-12-14_06:16:41.458739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:43.222465 run osmo-stp_10.42.42.5(pid=16632): stderr: | 20221214061641630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061641631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061641631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061641631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061641632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061641632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061641632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:43.372290 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16632): Process ended prematurely: osmo-stp_10.42.42.5(pid=16632) [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16632)] [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:16:43.381600 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:16:43.408123 run osmo-hlr_10.42.42.2(pid=16629): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16629)] 06:16:43.457104 run osmo-hlr_10.42.42.2(pid=16629): stdout: | (launched: 2022-12-14_06:16:40.469705) 06:16:43.507326 run osmo-hlr_10.42.42.2(pid=16629): stderr: | 20221214061640648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061640648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061640648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061640649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061640649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061640649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061640660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061640668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061640669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061640669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:43.577577 run osmo-msc_10.42.42.6(pid=16635): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16635)] 06:16:43.625332 run osmo-msc_10.42.42.6(pid=16635): stdout: | (launched: 2022-12-14_06:16:42.461479) 06:16:43.675446 run osmo-msc_10.42.42.6(pid=16635): stderr: | 20221214061642732 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061642732 DLGLOBAL DEBUG validating counter group 0x7f4a5fda5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061642732 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061642732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061642732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061642732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061642734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061642735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061642735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061642735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:43.725705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16628): Terminating (SIGTERM) 06:16:43.766134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16631): Terminating (SIGTERM) 06:16:43.806643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16634): Terminating (SIGTERM) 06:16:43.847346 --- ParallelTerminationStrategy: PID 16628 died... 06:16:43.866998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16628): Terminated: ok {rc=0} 06:16:43.911371 --- ParallelTerminationStrategy: PID 16631 died... 06:16:43.930417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16631): Terminated: ok {rc=0} 06:16:43.974671 --- ParallelTerminationStrategy: PID 16634 died... 06:16:43.993718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16634): Terminated: ok {rc=0} 06:16:44.079282 bus /sierra_3: Setting Powered False 06:16:45.178057 bus /sierra_3: Setting Powered False 06:16:46.292496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:16:47.444516 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:47.456859 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:16:47.529512 tst mo_mt_call_osmux.py: using LAC 38978 06:16:47.659990 tst mo_mt_call_osmux.py: using RAC 218 06:16:47.785645 tst mo_mt_call_osmux.py: using CellId 38978 06:16:47.908094 tst mo_mt_call_osmux.py: using BVCI 38979 06:16:48.021107 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:48.031920 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:48.042643 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:48.053286 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:48.064273 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:16:48.075376 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:16:48.195783 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:16:48.312761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:48.797257 run create_hlr_db(pid=16637): Launched 06:16:48.917299 bus /sierra_2: Setting Powered False 06:16:49.979127 run create_hlr_db(pid=16637): Terminated: ok {rc=0} 06:16:50.415443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16639): Launched 06:16:50.729720 run osmo-hlr_10.42.42.2(pid=16640): Launched 06:16:50.849091 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:51.401200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16642): Launched 06:16:51.713374 run osmo-stp_10.42.42.5(pid=16643): Launched 06:16:51.833509 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:52.397921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16645): Launched 06:16:52.711105 run osmo-msc_10.42.42.6(pid=16646): Launched 06:16:52.886151 run osmo-stp_10.42.42.5(pid=16643): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16643)] 06:16:53.019828 run osmo-stp_10.42.42.5(pid=16643): stdout: | (launched: 2022-12-14_06:16:51.655679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:53.152182 run osmo-stp_10.42.42.5(pid=16643): stderr: | 20221214061651827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061651827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061651827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061651828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061651828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061651828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061651828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:53.282703 run osmo-stp_10.42.42.5(pid=16643): stdout: | (launched: 2022-12-14_06:16:51.655679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:53.407267 run osmo-stp_10.42.42.5(pid=16643): stderr: | 20221214061651827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061651827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061651827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061651828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061651828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061651828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061651828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:53.556170 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16643): Process ended prematurely: osmo-stp_10.42.42.5(pid=16643) [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16643)] [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:16:53.565103 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:16:53.591687 run osmo-hlr_10.42.42.2(pid=16640): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16640)] 06:16:53.640883 run osmo-hlr_10.42.42.2(pid=16640): stdout: | (launched: 2022-12-14_06:16:50.672028) 06:16:53.690957 run osmo-hlr_10.42.42.2(pid=16640): stderr: | 20221214061650846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061650847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061650847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061650847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061650847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061650847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061650859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061650868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061650869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061650869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:53.760838 run osmo-msc_10.42.42.6(pid=16646): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16646)] 06:16:53.808836 run osmo-msc_10.42.42.6(pid=16646): stdout: | (launched: 2022-12-14_06:16:52.653388) 06:16:53.858376 run osmo-msc_10.42.42.6(pid=16646): stderr: | 20221214061652925 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061652925 DLGLOBAL DEBUG validating counter group 0x7f76bbf6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061652926 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061652926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061652926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061652926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061652928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061652928 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061652928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061652928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:53.908457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16639): Terminating (SIGTERM) 06:16:53.948789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16642): Terminating (SIGTERM) 06:16:53.989037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16645): Terminating (SIGTERM) 06:16:54.029445 --- ParallelTerminationStrategy: PID 16639 died... 06:16:54.048920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16639): Terminated: ok {rc=0} 06:16:54.093388 --- ParallelTerminationStrategy: PID 16642 died... 06:16:54.112455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16642): Terminated: ok {rc=0} 06:16:54.157246 --- ParallelTerminationStrategy: PID 16645 died... 06:16:54.176449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16645): Terminated: ok {rc=0} 06:16:54.265128 bus /sierra_3: Setting Powered False 06:16:55.367364 bus /sierra_3: Setting Powered False 06:16:56.487509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:trx-lms --------------------------------------------------------------------- 06:16:57.740026 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:16:57.744528 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 06:16:57.777146 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:16:57.804697 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 06:16:57.888983 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 06:16:57.921671 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:16:57.948328 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 06:16:58.535416 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 06:16:58.541100 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:58.552693 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 06:16:58.602244 tst emergency_mo_mt_call.py: using LAC 38979 06:16:58.722317 tst emergency_mo_mt_call.py: using RAC 219 06:16:58.849089 tst emergency_mo_mt_call.py: using CellId 38979 06:16:58.970855 tst emergency_mo_mt_call.py: using BVCI 38980 06:16:59.084210 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:59.094874 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:59.105425 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:59.115824 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:59.126209 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:59.137763 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:59.259101 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:59.380532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:59.856534 run create_hlr_db(pid=16654): Launched 06:16:59.973450 bus /sierra_2: Setting Powered False 06:17:01.048863 run create_hlr_db(pid=16654): Terminated: ok {rc=0} 06:17:01.624179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16659): Launched 06:17:01.993284 run osmo-hlr_10.42.42.2(pid=16660): Launched 06:17:02.252716 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:02.822978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16662): Launched 06:17:03.130270 run osmo-stp_10.42.42.5(pid=16663): Launched 06:17:03.257878 tst emergency_mo_mt_call.py: using MSISDN 8535 06:17:03.422343 run osmo-msc_10.42.42.6: Starting osmo-msc 06:17:03.975979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16665): Launched 06:17:04.283159 run osmo-msc_10.42.42.6(pid=16666): Launched 06:17:04.456165 run osmo-stp_10.42.42.5(pid=16663): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16663)] 06:17:04.586438 run osmo-stp_10.42.42.5(pid=16663): stdout: | (launched: 2022-12-14_06:17:03.073161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:04.716259 run osmo-stp_10.42.42.5(pid=16663): stderr: | 20221214061703244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061703244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061703244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061703245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061703245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061703245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061703245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:04.844037 run osmo-stp_10.42.42.5(pid=16663): stdout: | (launched: 2022-12-14_06:17:03.073161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:04.966109 run osmo-stp_10.42.42.5(pid=16663): stderr: | 20221214061703244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061703244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061703244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061703245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061703245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061703245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061703245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:05.112122 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16663): Process ended prematurely: osmo-stp_10.42.42.5(pid=16663) [trial-2400↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16663)] [trial-2400↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 06:17:05.120540 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 06:17:05.146617 run osmo-hlr_10.42.42.2(pid=16660): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16660)] 06:17:05.195552 run osmo-hlr_10.42.42.2(pid=16660): stdout: | (launched: 2022-12-14_06:17:01.924379) 06:17:05.245721 run osmo-hlr_10.42.42.2(pid=16660): stderr: | 20221214061702146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061702146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061702146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061702146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061702146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061702146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061702160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061702181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061702181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061702181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:05.315493 run osmo-msc_10.42.42.6(pid=16666): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16666)] 06:17:05.363832 run osmo-msc_10.42.42.6(pid=16666): stdout: | (launched: 2022-12-14_06:17:04.226180) 06:17:05.413753 run osmo-msc_10.42.42.6(pid=16666): stderr: | 20221214061704498 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061704498 DLGLOBAL DEBUG validating counter group 0x7f8c4f5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061704498 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061704498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061704499 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061704499 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061704500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061704501 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061704501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061704501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:17:05.463588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16659): Terminating (SIGTERM) 06:17:05.503729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16662): Terminating (SIGTERM) 06:17:05.543796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16665): Terminating (SIGTERM) 06:17:05.584100 --- ParallelTerminationStrategy: PID 16659 died... 06:17:05.603634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16659): Terminated: ok {rc=0} 06:17:05.648165 --- ParallelTerminationStrategy: PID 16662 died... 06:17:05.667845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16662): Terminated: ok {rc=0} 06:17:05.712111 --- ParallelTerminationStrategy: PID 16665 died... 06:17:05.731182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16665): Terminated: ok {rc=0} 06:17:05.815753 bus /sierra_3: Setting Powered False 06:17:06.914277 bus /sierra_3: Setting Powered False 06:17:08.033744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 06:17:09.121059 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:17:09.132925 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 06:17:09.185291 tst emergency_preemptive_call.py: using LAC 38980 06:17:09.315179 tst emergency_preemptive_call.py: using RAC 220 06:17:09.458124 tst emergency_preemptive_call.py: using CellId 38980 06:17:09.583215 tst emergency_preemptive_call.py: using BVCI 38981 06:17:09.694358 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:17:09.705281 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:17:09.715793 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:17:09.726493 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:17:09.737520 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:17:09.748162 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:17:09.863581 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:17:09.984093 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:17:10.100475 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:17:10.217540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:10.694792 run create_hlr_db(pid=16668): Launched 06:17:10.811896 bus /sierra_2: Setting Powered False 06:17:11.872266 run create_hlr_db(pid=16668): Terminated: ok {rc=0} 06:17:12.301687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16670): Launched 06:17:12.609608 run osmo-hlr_10.42.42.2(pid=16671): Launched 06:17:12.727413 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:13.260661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16673): Launched 06:17:13.570364 run osmo-stp_10.42.42.5(pid=16674): Launched 06:17:13.698430 tst emergency_preemptive_call.py: using MSISDN 8536 06:17:13.865201 run osmo-msc_10.42.42.6: Starting osmo-msc 06:17:14.417523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16676): Launched 06:17:14.724304 run osmo-msc_10.42.42.6(pid=16677): Launched 06:17:14.896572 run osmo-stp_10.42.42.5(pid=16674): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16674)] 06:17:15.026674 run osmo-stp_10.42.42.5(pid=16674): stdout: | (launched: 2022-12-14_06:17:13.513330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:15.156032 run osmo-stp_10.42.42.5(pid=16674): stderr: | 20221214061713682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061713682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061713683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061713683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061713683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061713684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061713684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:15.284306 run osmo-stp_10.42.42.5(pid=16674): stdout: | (launched: 2022-12-14_06:17:13.513330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:15.406696 run osmo-stp_10.42.42.5(pid=16674): stderr: | 20221214061713682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061713682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061713683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061713683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061713683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061713684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061713684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:15.552221 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16674): Process ended prematurely: osmo-stp_10.42.42.5(pid=16674) [trial-2400↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16674)] [trial-2400↪emergency:trx-lms↪emergency_preemptive_call.py:32] 06:17:15.560609 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 06:17:15.586922 run osmo-hlr_10.42.42.2(pid=16671): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16671)] 06:17:15.635646 run osmo-hlr_10.42.42.2(pid=16671): stdout: | (launched: 2022-12-14_06:17:12.552433) 06:17:15.685766 run osmo-hlr_10.42.42.2(pid=16671): stderr: | 20221214061712730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061712730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061712730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061712730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061712730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061712730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061712742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061712753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061712753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061712753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:15.756034 run osmo-msc_10.42.42.6(pid=16677): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16677)] 06:17:15.804021 run osmo-msc_10.42.42.6(pid=16677): stdout: | (launched: 2022-12-14_06:17:14.667439) 06:17:15.869874 run osmo-msc_10.42.42.6(pid=16677): stderr: | 20221214061714939 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214061714939 DLGLOBAL DEBUG validating counter group 0x7f809b3cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214061714939 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214061714939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214061714939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214061714939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214061714941 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214061714942 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214061714942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214061714942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:17:15.938952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16670): Terminating (SIGTERM) 06:17:15.991197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16673): Terminating (SIGTERM) 06:17:16.047700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16676): Terminating (SIGTERM) 06:17:16.104241 --- ParallelTerminationStrategy: PID 16670 died... 06:17:16.124752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16670): Terminated: ok {rc=0} 06:17:16.173232 --- ParallelTerminationStrategy: PID 16673 died... 06:17:16.194594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16673): Terminated: ok {rc=0} 06:17:16.242531 --- ParallelTerminationStrategy: PID 16676 died... 06:17:16.263682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16676): Terminated: ok {rc=0} 06:17:16.354584 bus /sierra_9: Setting Powered False 06:17:17.451298 bus /sierra_9: Setting Powered False 06:17:18.567802 bus /sierra_8: Setting Powered False 06:17:19.668333 bus /sierra_8: Setting Powered False 06:17:20.785412 bus /sierra_3: Setting Powered False 06:17:21.885280 bus /sierra_3: Setting Powered False 06:17:23.000365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms --------------------------------------------------------------------- 06:17:24.284316 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:17:24.289182 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 06:17:24.323225 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 06:17:24.363115 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 06:17:24.452579 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 06:17:24.486797 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 06:17:24.526456 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 06:17:25.117437 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 06:17:25.171553 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.182666 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:17:25.232200 tst cs_paging_gprs_active.py: using LAC 38981 06:17:25.365408 tst cs_paging_gprs_active.py: using RAC 221 06:17:25.496818 tst cs_paging_gprs_active.py: using CellId 38981 06:17:25.629231 tst cs_paging_gprs_active.py: using BVCI 38982 06:17:25.744469 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.755762 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.766451 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.777159 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.788790 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.799703 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.810826 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.821685 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:25.832569 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:25.954005 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:26.073520 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:17:26.302327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:26.638914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16682): Launched 06:17:26.931128 run iperf3-srv_10.42.42.10(pid=16683): Launched 06:17:27.056813 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:17:27.283874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:27.622076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16684): Launched 06:17:27.914082 run iperf3-srv_10.42.42.10(pid=16685): Launched 06:17:28.040791 tst cs_paging_gprs_active.py:38: start network... 06:17:28.267214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:28.786341 run create_hlr_db(pid=16686): Launched 06:17:28.921531 bus /sierra_2: Setting Powered False 06:17:29.987371 run create_hlr_db(pid=16686): Terminated: ok {rc=0} 06:17:30.452422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16688): Launched 06:17:30.786622 run osmo-hlr_10.42.42.2(pid=16689): Launched 06:17:31.010948 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:31.770985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16691): Launched 06:17:32.127104 run osmo-stp_10.42.42.5(pid=16692): Launched 06:17:32.385020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:32.933698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16694): Launched 06:17:33.054021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:33.320381 run patchelf(pid=16695): Launched 06:17:33.495606 run osmo-stp_10.42.42.5(pid=16692): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16692)] 06:17:33.628284 run osmo-stp_10.42.42.5(pid=16692): stdout: | (launched: 2022-12-14_06:17:32.064331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:33.762995 run osmo-stp_10.42.42.5(pid=16692): stderr: | 20221214061732253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061732253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061732253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061732254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061732254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061732254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061732254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:33.897840 run osmo-stp_10.42.42.5(pid=16692): stdout: | (launched: 2022-12-14_06:17:32.064331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:34.025802 run osmo-stp_10.42.42.5(pid=16692): stderr: | 20221214061732253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061732253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061732253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061732254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061732254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061732254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061732254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:34.177870 run patchelf(pid=16695): Terminating (SIGINT) 06:17:34.353990 run patchelf(pid=16695): Terminated: ok {rc=0} 06:17:34.480771 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16692): Process ended prematurely: osmo-stp_10.42.42.5(pid=16692) [trial-2400↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16692)] [trial-2400↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 06:17:34.490447 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 06:17:34.517655 run osmo-hlr_10.42.42.2(pid=16689): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16689)] 06:17:34.566466 run osmo-hlr_10.42.42.2(pid=16689): stdout: | (launched: 2022-12-14_06:17:30.724897) 06:17:34.616073 run osmo-hlr_10.42.42.2(pid=16689): stderr: | 20221214061730978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061730978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061730978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061730978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061730978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061730978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061731004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061731021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061731022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061731022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:34.666574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16682): Terminating (SIGTERM) 06:17:34.707255 run iperf3-srv_10.42.42.10(pid=16683): Terminating (SIGTERM) 06:17:34.747778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16684): Terminating (SIGTERM) 06:17:34.788311 run iperf3-srv_10.42.42.10(pid=16685): Terminating (SIGTERM) 06:17:34.828983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16688): Terminating (SIGTERM) 06:17:34.869719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16691): Terminating (SIGTERM) 06:17:34.910473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16694): Terminating (SIGTERM) 06:17:34.951940 --- ParallelTerminationStrategy: PID 16682 died... 06:17:34.971820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16682): Terminated: ok {rc=0} 06:17:35.016782 --- ParallelTerminationStrategy: PID 16683 died... 06:17:35.036122 run iperf3-srv_10.42.42.10(pid=16683): Terminated {rc=256} 06:17:35.080790 --- ParallelTerminationStrategy: PID 16684 died... 06:17:35.100173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16684): Terminated: ok {rc=0} 06:17:35.144835 --- ParallelTerminationStrategy: PID 16685 died... 06:17:35.164514 run iperf3-srv_10.42.42.10(pid=16685): Terminated {rc=256} 06:17:35.208728 --- ParallelTerminationStrategy: PID 16688 died... 06:17:35.227497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16688): Terminated: ok {rc=0} 06:17:35.272031 --- ParallelTerminationStrategy: PID 16691 died... 06:17:35.291282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16691): Terminated: ok {rc=0} 06:17:35.335472 --- ParallelTerminationStrategy: PID 16694 died... 06:17:35.354685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16694): Terminated: ok {rc=0} 06:17:35.439438 bus /gobi_0: Setting Powered False 06:17:36.538892 bus /gobi_0: Setting Powered False 06:17:37.657576 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms iperf3.py ---------------------------------------------- 06:17:38.809975 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:38.821675 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:17:38.875283 tst iperf3.py: using LAC 38982 06:17:39.008509 tst iperf3.py: using RAC 222 06:17:39.140930 tst iperf3.py: using CellId 38982 06:17:39.271037 tst iperf3.py: using BVCI 38983 06:17:39.395278 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.406749 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.417952 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.429076 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.440085 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.451166 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.462453 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.473596 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:39.484758 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:39.604868 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:17:39.831278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:40.168121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16696): Launched 06:17:40.461086 run iperf3-srv_10.42.42.10(pid=16697): Launched 06:17:40.586610 tst iperf3.py:8: start network... 06:17:40.812591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:41.331538 run create_hlr_db(pid=16698): Launched 06:17:41.465991 bus /gobi_6: Setting Powered False 06:17:42.531361 run create_hlr_db(pid=16698): Terminated: ok {rc=0} 06:17:42.995085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16700): Launched 06:17:43.330100 run osmo-hlr_10.42.42.2(pid=16701): Launched 06:17:43.457088 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:44.033680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16703): Launched 06:17:44.367966 run osmo-stp_10.42.42.5(pid=16704): Launched 06:17:44.494861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:45.068450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16706): Launched 06:17:45.195725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:45.479345 run patchelf(pid=16707): Launched 06:17:45.664565 run osmo-stp_10.42.42.5(pid=16704): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16704)] 06:17:45.804683 run osmo-stp_10.42.42.5(pid=16704): stdout: | (launched: 2022-12-14_06:17:44.306609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:45.970134 run osmo-stp_10.42.42.5(pid=16704): stderr: | 20221214061744501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061744502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061744502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061744502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061744503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061744503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061744503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:46.114711 run osmo-stp_10.42.42.5(pid=16704): stdout: | (launched: 2022-12-14_06:17:44.306609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:46.253490 run osmo-stp_10.42.42.5(pid=16704): stderr: | 20221214061744501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061744502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061744502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061744502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061744503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061744503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061744503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:46.417826 run patchelf(pid=16707): Terminating (SIGINT) 06:17:46.607504 run patchelf(pid=16707): Terminated: ok {rc=0} 06:17:46.745268 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16704): Process ended prematurely: osmo-stp_10.42.42.5(pid=16704) [trial-2400↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16704)] [trial-2400↪gprs:trx-lms↪iperf3.py:8] 06:17:46.756116 tst iperf3.py:8: Test FAILED (8.0 sec) 06:17:46.785734 run osmo-hlr_10.42.42.2(pid=16701): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16701)] 06:17:46.837129 run osmo-hlr_10.42.42.2(pid=16701): stdout: | (launched: 2022-12-14_06:17:43.268245) 06:17:46.889985 run osmo-hlr_10.42.42.2(pid=16701): stderr: | 20221214061743468 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061743468 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061743468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061743468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061743468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061743469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061743481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061743489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061743490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061743490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:46.943141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16696): Terminating (SIGTERM) 06:17:46.985734 run iperf3-srv_10.42.42.10(pid=16697): Terminating (SIGTERM) 06:17:47.028252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16700): Terminating (SIGTERM) 06:17:47.071420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16703): Terminating (SIGTERM) 06:17:47.115989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16706): Terminating (SIGTERM) 06:17:47.160263 --- ParallelTerminationStrategy: PID 16696 died... 06:17:47.180788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16696): Terminated: ok {rc=0} 06:17:47.227844 --- ParallelTerminationStrategy: PID 16697 died... 06:17:47.247529 run iperf3-srv_10.42.42.10(pid=16697): Terminated {rc=256} 06:17:47.294047 --- ParallelTerminationStrategy: PID 16700 died... 06:17:47.313983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16700): Terminated: ok {rc=0} 06:17:47.360409 --- ParallelTerminationStrategy: PID 16703 died... 06:17:47.380221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16703): Terminated: ok {rc=0} 06:17:47.426483 --- ParallelTerminationStrategy: PID 16706 died... 06:17:47.446170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16706): Terminated: ok {rc=0} 06:17:47.534518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms iperf3m4.py ---------------------------------------------- 06:17:48.687300 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:48.699051 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:17:48.749791 tst iperf3m4.py: using LAC 38983 06:17:48.880607 tst iperf3m4.py: using RAC 223 06:17:49.012796 tst iperf3m4.py: using CellId 38983 06:17:49.142984 tst iperf3m4.py: using BVCI 38984 06:17:49.259634 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.270626 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.281241 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.291734 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.302690 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.313611 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.324346 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.335142 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:49.346292 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:49.468609 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:49.593998 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:49.713152 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:49.835693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:17:50.061722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:50.397814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16708): Launched 06:17:50.687659 run iperf3-srv_10.42.42.10(pid=16709): Launched 06:17:50.812147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:17:51.036922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:51.372344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16710): Launched 06:17:51.663253 run iperf3-srv_10.42.42.10(pid=16711): Launched 06:17:51.787586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:17:52.012467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:52.348338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16712): Launched 06:17:52.637809 run iperf3-srv_10.42.42.10(pid=16713): Launched 06:17:52.761599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:17:52.985401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:53.320031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16714): Launched 06:17:53.610057 run iperf3-srv_10.42.42.10(pid=16715): Launched 06:17:53.734725 tst iperf3m4.py:8: start network... 06:17:53.959671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:54.477352 run create_hlr_db(pid=16716): Launched 06:17:54.611918 bus /gobi_6: Setting Powered False 06:17:55.678693 run create_hlr_db(pid=16716): Terminated: ok {rc=0} 06:17:56.141660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16718): Launched 06:17:56.475351 run osmo-hlr_10.42.42.2(pid=16719): Launched 06:17:56.601928 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:57.175284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16721): Launched 06:17:57.509275 run osmo-stp_10.42.42.5(pid=16722): Launched 06:17:57.635800 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:58.211550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16724): Launched 06:17:58.339344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:58.621169 run patchelf(pid=16725): Launched 06:17:58.805614 run osmo-stp_10.42.42.5(pid=16722): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16722)] 06:17:58.946242 run osmo-stp_10.42.42.5(pid=16722): stdout: | (launched: 2022-12-14_06:17:57.447849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:59.088599 run osmo-stp_10.42.42.5(pid=16722): stderr: | 20221214061757638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061757638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061757639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061757639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061757639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061757640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061757640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:59.231299 run osmo-stp_10.42.42.5(pid=16722): stdout: | (launched: 2022-12-14_06:17:57.447849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:59.367718 run osmo-stp_10.42.42.5(pid=16722): stderr: | 20221214061757638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061757638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061757639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061757639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061757639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061757640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061757640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:59.529339 run patchelf(pid=16725): Terminating (SIGINT) 06:17:59.715305 run patchelf(pid=16725): Terminated: ok {rc=0} 06:17:59.848907 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16722): Process ended prematurely: osmo-stp_10.42.42.5(pid=16722) [trial-2400↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16722)] [trial-2400↪gprs:trx-lms↪iperf3m4.py:8] 06:17:59.859609 tst iperf3m4.py:8: Test FAILED (11.2 sec) 06:17:59.888440 run osmo-hlr_10.42.42.2(pid=16719): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16719)] 06:17:59.938619 run osmo-hlr_10.42.42.2(pid=16719): stdout: | (launched: 2022-12-14_06:17:56.414180) 06:17:59.990941 run osmo-hlr_10.42.42.2(pid=16719): stderr: | 20221214061756612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061756612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061756612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061756612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061756612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061756612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061756624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061756633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061756633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061756633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:00.043198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16708): Terminating (SIGTERM) 06:18:00.085382 run iperf3-srv_10.42.42.10(pid=16709): Terminating (SIGTERM) 06:18:00.127549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16710): Terminating (SIGTERM) 06:18:00.170050 run iperf3-srv_10.42.42.10(pid=16711): Terminating (SIGTERM) 06:18:00.212251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16712): Terminating (SIGTERM) 06:18:00.255131 run iperf3-srv_10.42.42.10(pid=16713): Terminating (SIGTERM) 06:18:00.297791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16714): Terminating (SIGTERM) 06:18:00.340374 run iperf3-srv_10.42.42.10(pid=16715): Terminating (SIGTERM) 06:18:00.383049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16718): Terminating (SIGTERM) 06:18:00.425493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16721): Terminating (SIGTERM) 06:18:00.467778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16724): Terminating (SIGTERM) 06:18:00.510400 --- ParallelTerminationStrategy: PID 16708 died... 06:18:00.530587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16708): Terminated: ok {rc=0} 06:18:00.577423 --- ParallelTerminationStrategy: PID 16709 died... 06:18:00.597051 run iperf3-srv_10.42.42.10(pid=16709): Terminated {rc=256} 06:18:00.643522 --- ParallelTerminationStrategy: PID 16710 died... 06:18:00.663178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16710): Terminated: ok {rc=0} 06:18:00.709542 --- ParallelTerminationStrategy: PID 16711 died... 06:18:00.729233 run iperf3-srv_10.42.42.10(pid=16711): Terminated {rc=256} 06:18:00.775644 --- ParallelTerminationStrategy: PID 16712 died... 06:18:00.795351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16712): Terminated: ok {rc=0} 06:18:00.841807 --- ParallelTerminationStrategy: PID 16713 died... 06:18:00.861446 run iperf3-srv_10.42.42.10(pid=16713): Terminated {rc=256} 06:18:00.908243 --- ParallelTerminationStrategy: PID 16714 died... 06:18:00.928275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16714): Terminated: ok {rc=0} 06:18:00.975128 --- ParallelTerminationStrategy: PID 16715 died... 06:18:00.995131 run iperf3-srv_10.42.42.10(pid=16715): Terminated {rc=256} 06:18:01.042145 --- ParallelTerminationStrategy: PID 16718 died... 06:18:01.061970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16718): Terminated: ok {rc=0} 06:18:01.109350 --- ParallelTerminationStrategy: PID 16721 died... 06:18:01.129420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16721): Terminated: ok {rc=0} 06:18:01.176475 --- ParallelTerminationStrategy: PID 16724 died... 06:18:01.196593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16724): Terminated: ok {rc=0} 06:18:01.289488 bus /gobi_4: Setting Powered False 06:18:02.401976 bus /gobi_4: Setting Powered False 06:18:03.516709 bus /gobi_1: Setting Powered False 06:18:04.615657 bus /gobi_1: Setting Powered False 06:18:05.734181 bus /gobi_0: Setting Powered False 06:18:06.835223 bus /gobi_0: Setting Powered False 06:18:07.953862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms ping.py ---------------------------------------------- 06:18:09.056399 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.067698 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:18:09.119936 tst ping.py: using LAC 38984 06:18:09.247676 tst ping.py: using RAC 224 06:18:09.376807 tst ping.py: using CellId 38984 06:18:09.503266 tst ping.py: using BVCI 38985 06:18:09.622606 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.633812 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.644819 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.655673 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.666522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.677283 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.688190 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:09.699116 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:18:09.819000 tst ping.py:19: start network... 06:18:10.041175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:10.550319 run create_hlr_db(pid=16726): Launched 06:18:10.685373 bus /gobi_6: Setting Powered False 06:18:11.750468 run create_hlr_db(pid=16726): Terminated: ok {rc=0} 06:18:12.190098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16728): Launched 06:18:12.498473 run osmo-hlr_10.42.42.2(pid=16729): Launched 06:18:12.616571 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:13.163479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16731): Launched 06:18:13.470564 run osmo-stp_10.42.42.5(pid=16732): Launched 06:18:13.589556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:14.119983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16734): Launched 06:18:14.237839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:14.498263 run patchelf(pid=16735): Launched 06:18:14.669243 run osmo-stp_10.42.42.5(pid=16732): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16732)] 06:18:14.799132 run osmo-stp_10.42.42.5(pid=16732): stdout: | (launched: 2022-12-14_06:18:13.413842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:14.931264 run osmo-stp_10.42.42.5(pid=16732): stderr: | 20221214061813585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061813585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061813585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061813586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061813586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061813586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061813586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:15.063668 run osmo-stp_10.42.42.5(pid=16732): stdout: | (launched: 2022-12-14_06:18:13.413842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:15.189572 run osmo-stp_10.42.42.5(pid=16732): stderr: | 20221214061813585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061813585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061813585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061813586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061813586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061813586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061813586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:15.338894 run patchelf(pid=16735): Terminating (SIGINT) 06:18:15.511202 run patchelf(pid=16735): Terminated: ok {rc=0} 06:18:15.635221 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16732): Process ended prematurely: osmo-stp_10.42.42.5(pid=16732) [trial-2400↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16732)] [trial-2400↪gprs:trx-lms↪ping.py:22] 06:18:15.644285 tst ping.py:22: Test FAILED (6.6 sec) 06:18:15.671262 run osmo-hlr_10.42.42.2(pid=16729): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16729)] 06:18:15.719683 run osmo-hlr_10.42.42.2(pid=16729): stdout: | (launched: 2022-12-14_06:18:12.441634) 06:18:15.769495 run osmo-hlr_10.42.42.2(pid=16729): stderr: | 20221214061812617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061812617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061812617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061812617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061812617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061812617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061812629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061812637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061812637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061812637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:15.820444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16728): Terminating (SIGTERM) 06:18:15.884281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16731): Terminating (SIGTERM) 06:18:15.931781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16734): Terminating (SIGTERM) 06:18:15.974669 --- ParallelTerminationStrategy: PID 16728 died... 06:18:15.995793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16728): Terminated: ok {rc=0} 06:18:16.043395 --- ParallelTerminationStrategy: PID 16731 died... 06:18:16.064497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16731): Terminated: ok {rc=0} 06:18:16.111375 --- ParallelTerminationStrategy: PID 16734 died... 06:18:16.132354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16734): Terminated: ok {rc=0} 06:18:16.219893 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 06:18:17.307061 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.318521 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:18:17.368382 tst ping_idle_ping.py: using LAC 38985 06:18:17.490615 tst ping_idle_ping.py: using RAC 225 06:18:17.616599 tst ping_idle_ping.py: using CellId 38985 06:18:17.736608 tst ping_idle_ping.py: using BVCI 38986 06:18:17.848759 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.859694 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.870333 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.880651 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.891434 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.902601 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.913475 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:18:17.924564 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:18:18.041533 tst ping_idle_ping.py:24: start network... 06:18:18.249760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:18.732428 run create_hlr_db(pid=16736): Launched 06:18:18.851425 bus /gobi_6: Setting Powered False 06:18:19.912749 run create_hlr_db(pid=16736): Terminated: ok {rc=0} 06:18:20.365920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16738): Launched 06:18:20.697570 run osmo-hlr_10.42.42.2(pid=16739): Launched 06:18:20.823834 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:21.398906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16741): Launched 06:18:21.728382 run osmo-stp_10.42.42.5(pid=16742): Launched 06:18:21.854191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:22.422362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16744): Launched 06:18:22.547749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:22.826201 run patchelf(pid=16745): Launched 06:18:23.009315 run osmo-stp_10.42.42.5(pid=16742): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16742)] 06:18:23.148288 run osmo-stp_10.42.42.5(pid=16742): stdout: | (launched: 2022-12-14_06:18:21.667557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:23.289250 run osmo-stp_10.42.42.5(pid=16742): stderr: | 20221214061821860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061821860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061821861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061821861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061821861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061821862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061821862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:23.430265 run osmo-stp_10.42.42.5(pid=16742): stdout: | (launched: 2022-12-14_06:18:21.667557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:23.565171 run osmo-stp_10.42.42.5(pid=16742): stderr: | 20221214061821860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061821860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061821861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061821861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061821861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061821862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061821862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:23.725091 run patchelf(pid=16745): Terminating (SIGINT) 06:18:23.909095 run patchelf(pid=16745): Terminated: ok {rc=0} 06:18:24.041133 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16742): Process ended prematurely: osmo-stp_10.42.42.5(pid=16742) [trial-2400↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16742)] [trial-2400↪gprs:trx-lms↪ping_idle_ping.py:27] 06:18:24.050877 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:18:24.079335 run osmo-hlr_10.42.42.2(pid=16739): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16739)] 06:18:24.130057 run osmo-hlr_10.42.42.2(pid=16739): stdout: | (launched: 2022-12-14_06:18:20.636495) 06:18:24.182523 run osmo-hlr_10.42.42.2(pid=16739): stderr: | 20221214061820835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061820836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061820836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061820836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061820836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061820836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061820847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061820855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061820856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061820856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:24.236144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16738): Terminating (SIGTERM) 06:18:24.279257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16741): Terminating (SIGTERM) 06:18:24.323093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16744): Terminating (SIGTERM) 06:18:24.366287 --- ParallelTerminationStrategy: PID 16738 died... 06:18:24.386834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16738): Terminated: ok {rc=0} 06:18:24.433822 --- ParallelTerminationStrategy: PID 16741 died... 06:18:24.453946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16741): Terminated: ok {rc=0} 06:18:24.500821 --- ParallelTerminationStrategy: PID 16744 died... 06:18:24.521321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16744): Terminated: ok {rc=0} 06:18:24.610315 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 06:18:25.913982 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:18:25.919876 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:18:25.954041 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:18:25.994996 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:18:26.084591 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:18:26.118999 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:18:26.158884 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:18:26.752599 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:18:26.807100 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:26.818685 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:18:26.870643 tst cs_paging_gprs_active.py: using LAC 38986 06:18:27.000935 tst cs_paging_gprs_active.py: using RAC 226 06:18:27.131904 tst cs_paging_gprs_active.py: using CellId 38986 06:18:27.263112 tst cs_paging_gprs_active.py: using BVCI 38987 06:18:27.386891 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.398398 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.409562 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.420699 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.432009 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.443346 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.454907 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.466405 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:27.478197 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:27.597438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:27.714445 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:18:27.926732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:28.243819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16749): Launched 06:18:28.519016 run iperf3-srv_10.42.42.10(pid=16750): Launched 06:18:28.637303 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:18:28.848126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:29.164915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16751): Launched 06:18:29.439526 run iperf3-srv_10.42.42.10(pid=16752): Launched 06:18:29.558228 tst cs_paging_gprs_active.py:38: start network... 06:18:29.768754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:30.255466 run create_hlr_db(pid=16753): Launched 06:18:30.376029 bus /gobi_6: Setting Powered False 06:18:31.445421 run create_hlr_db(pid=16753): Terminated: ok {rc=0} 06:18:31.948194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16755): Launched 06:18:32.307234 run osmo-hlr_10.42.42.2(pid=16756): Launched 06:18:32.435466 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:33.010568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16758): Launched 06:18:33.345648 run osmo-stp_10.42.42.5(pid=16759): Launched 06:18:33.472943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:34.050922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16761): Launched 06:18:34.178801 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:34.463188 run patchelf(pid=16762): Launched 06:18:34.650715 run osmo-stp_10.42.42.5(pid=16759): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16759)] 06:18:34.792404 run osmo-stp_10.42.42.5(pid=16759): stdout: | (launched: 2022-12-14_06:18:33.283810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:34.935905 run osmo-stp_10.42.42.5(pid=16759): stderr: | 20221214061833480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061833480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061833480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061833481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061833481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061833481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061833481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:35.079424 run osmo-stp_10.42.42.5(pid=16759): stdout: | (launched: 2022-12-14_06:18:33.283810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:35.216322 run osmo-stp_10.42.42.5(pid=16759): stderr: | 20221214061833480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061833480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061833480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061833481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061833481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061833481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061833481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:35.379348 run patchelf(pid=16762): Terminating (SIGINT) 06:18:35.566525 run patchelf(pid=16762): Terminated: ok {rc=0} 06:18:35.701873 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16759): Process ended prematurely: osmo-stp_10.42.42.5(pid=16759) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16759)] [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:18:35.712341 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:18:35.741140 run osmo-hlr_10.42.42.2(pid=16756): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16756)] 06:18:35.791654 run osmo-hlr_10.42.42.2(pid=16756): stdout: | (launched: 2022-12-14_06:18:32.245316) 06:18:35.843811 run osmo-hlr_10.42.42.2(pid=16756): stderr: | 20221214061832445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061832445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061832445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061832445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061832445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061832445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061832457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061832466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061832466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061832466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:35.896547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16749): Terminating (SIGTERM) 06:18:35.938664 run iperf3-srv_10.42.42.10(pid=16750): Terminating (SIGTERM) 06:18:35.982530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16751): Terminating (SIGTERM) 06:18:36.024931 run iperf3-srv_10.42.42.10(pid=16752): Terminating (SIGTERM) 06:18:36.067060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16755): Terminating (SIGTERM) 06:18:36.109726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16758): Terminating (SIGTERM) 06:18:36.152326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16761): Terminating (SIGTERM) 06:18:36.194690 --- ParallelTerminationStrategy: PID 16749 died... 06:18:36.215106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16749): Terminated: ok {rc=0} 06:18:36.261772 --- ParallelTerminationStrategy: PID 16750 died... 06:18:36.281847 run iperf3-srv_10.42.42.10(pid=16750): Terminated {rc=256} 06:18:36.328158 --- ParallelTerminationStrategy: PID 16751 died... 06:18:36.348387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16751): Terminated: ok {rc=0} 06:18:36.394772 --- ParallelTerminationStrategy: PID 16752 died... 06:18:36.414768 run iperf3-srv_10.42.42.10(pid=16752): Terminated {rc=256} 06:18:36.461079 --- ParallelTerminationStrategy: PID 16755 died... 06:18:36.481071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16755): Terminated: ok {rc=0} 06:18:36.527596 --- ParallelTerminationStrategy: PID 16758 died... 06:18:36.547392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16758): Terminated: ok {rc=0} 06:18:36.593972 --- ParallelTerminationStrategy: PID 16761 died... 06:18:36.613937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16761): Terminated: ok {rc=0} 06:18:36.702466 bus /gobi_0: Setting Powered False 06:18:37.801503 bus /gobi_0: Setting Powered False 06:18:38.917624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:18:40.069522 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.081801 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:18:40.137670 tst iperf3.py: using LAC 38987 06:18:40.267536 tst iperf3.py: using RAC 227 06:18:40.397399 tst iperf3.py: using CellId 38987 06:18:40.526495 tst iperf3.py: using BVCI 38988 06:18:40.647822 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.659622 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.671041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.682641 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.694022 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.705337 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.716845 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.728135 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:40.739683 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:40.860553 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:18:41.087192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:41.424406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16763): Launched 06:18:41.716158 run iperf3-srv_10.42.42.10(pid=16764): Launched 06:18:41.841596 tst iperf3.py:8: start network... 06:18:42.068737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:42.587977 run create_hlr_db(pid=16765): Launched 06:18:42.722361 bus /gobi_6: Setting Powered False 06:18:43.787742 run create_hlr_db(pid=16765): Terminated: ok {rc=0} 06:18:44.239458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16767): Launched 06:18:44.577878 run osmo-hlr_10.42.42.2(pid=16768): Launched 06:18:44.704860 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:45.285780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16770): Launched 06:18:45.620540 run osmo-stp_10.42.42.5(pid=16771): Launched 06:18:45.746987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:46.415539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16773): Launched 06:18:46.569209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:46.845424 run patchelf(pid=16774): Launched 06:18:47.039808 run osmo-stp_10.42.42.5(pid=16771): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16771)] 06:18:47.177609 run osmo-stp_10.42.42.5(pid=16771): stdout: | (launched: 2022-12-14_06:18:45.559214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:47.313031 run osmo-stp_10.42.42.5(pid=16771): stderr: | 20221214061845755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061845755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061845755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061845756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061845756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061845756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061845757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:47.447711 run osmo-stp_10.42.42.5(pid=16771): stdout: | (launched: 2022-12-14_06:18:45.559214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:47.576037 run osmo-stp_10.42.42.5(pid=16771): stderr: | 20221214061845755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061845755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061845755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061845756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061845756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061845756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061845757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:47.728408 run patchelf(pid=16774): Terminating (SIGINT) 06:18:47.905183 run patchelf(pid=16774): Terminated: ok {rc=0} 06:18:48.032280 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16771): Process ended prematurely: osmo-stp_10.42.42.5(pid=16771) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16771)] [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 06:18:48.042150 tst iperf3.py:8: Test FAILED (8.0 sec) 06:18:48.069766 run osmo-hlr_10.42.42.2(pid=16768): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16768)] 06:18:48.118805 run osmo-hlr_10.42.42.2(pid=16768): stdout: | (launched: 2022-12-14_06:18:44.516171) 06:18:48.168836 run osmo-hlr_10.42.42.2(pid=16768): stderr: | 20221214061844718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061844718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061844718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061844718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061844718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061844718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061844730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061844738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061844739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061844739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:48.219427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16763): Terminating (SIGTERM) 06:18:48.259661 run iperf3-srv_10.42.42.10(pid=16764): Terminating (SIGTERM) 06:18:48.299921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16767): Terminating (SIGTERM) 06:18:48.340081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16770): Terminating (SIGTERM) 06:18:48.380689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16773): Terminating (SIGTERM) 06:18:48.421682 --- ParallelTerminationStrategy: PID 16763 died... 06:18:48.441451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16763): Terminated: ok {rc=0} 06:18:48.486285 --- ParallelTerminationStrategy: PID 16764 died... 06:18:48.505428 run iperf3-srv_10.42.42.10(pid=16764): Terminated {rc=256} 06:18:48.549468 --- ParallelTerminationStrategy: PID 16767 died... 06:18:48.568458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16767): Terminated: ok {rc=0} 06:18:48.613064 --- ParallelTerminationStrategy: PID 16770 died... 06:18:48.632118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16770): Terminated: ok {rc=0} 06:18:48.676689 --- ParallelTerminationStrategy: PID 16773 died... 06:18:48.695973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16773): Terminated: ok {rc=0} 06:18:48.783626 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:18:49.933626 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:49.945199 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:18:49.995101 tst iperf3m4.py: using LAC 38988 06:18:50.120576 tst iperf3m4.py: using RAC 228 06:18:50.245636 tst iperf3m4.py: using CellId 38988 06:18:50.379470 tst iperf3m4.py: using BVCI 38989 06:18:50.501027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.512877 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.524647 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.536034 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.547334 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.558836 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.570469 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.582014 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:50.593546 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:50.715039 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:50.836196 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:50.958085 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:51.079360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:18:51.291886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:51.609164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16775): Launched 06:18:51.884668 run iperf3-srv_10.42.42.10(pid=16776): Launched 06:18:52.003667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:18:52.215830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:52.533168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16777): Launched 06:18:52.807478 run iperf3-srv_10.42.42.10(pid=16778): Launched 06:18:52.925495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:18:53.136686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:53.454418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16779): Launched 06:18:53.728524 run iperf3-srv_10.42.42.10(pid=16780): Launched 06:18:53.845831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:18:54.056158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:54.373211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16781): Launched 06:18:54.647217 run iperf3-srv_10.42.42.10(pid=16782): Launched 06:18:54.764825 tst iperf3m4.py:8: start network... 06:18:54.974803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:55.462016 run create_hlr_db(pid=16783): Launched 06:18:55.580782 bus /gobi_6: Setting Powered False 06:18:56.643181 run create_hlr_db(pid=16783): Terminated: ok {rc=0} 06:18:57.081134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16785): Launched 06:18:57.396433 run osmo-hlr_10.42.42.2(pid=16786): Launched 06:18:57.517073 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:58.055556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16788): Launched 06:18:58.371437 run osmo-stp_10.42.42.5(pid=16789): Launched 06:18:58.491033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:59.032394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16791): Launched 06:18:59.152361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:59.418504 run patchelf(pid=16792): Launched 06:18:59.593126 run osmo-stp_10.42.42.5(pid=16789): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16789)] 06:18:59.725922 run osmo-stp_10.42.42.5(pid=16789): stdout: | (launched: 2022-12-14_06:18:58.312722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:59.860651 run osmo-stp_10.42.42.5(pid=16789): stderr: | 20221214061858482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061858482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061858483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061858483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061858483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061858484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061858484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:59.995244 run osmo-stp_10.42.42.5(pid=16789): stdout: | (launched: 2022-12-14_06:18:58.312722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:00.123922 run osmo-stp_10.42.42.5(pid=16789): stderr: | 20221214061858482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061858482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061858483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061858483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061858483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061858484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061858484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:00.277340 run patchelf(pid=16792): Terminating (SIGINT) 06:19:00.453939 run patchelf(pid=16792): Terminated: ok {rc=0} 06:19:00.581121 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16789): Process ended prematurely: osmo-stp_10.42.42.5(pid=16789) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16789)] [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 06:19:00.590700 tst iperf3m4.py:8: Test FAILED (10.7 sec) 06:19:00.618369 run osmo-hlr_10.42.42.2(pid=16786): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16786)] 06:19:00.667185 run osmo-hlr_10.42.42.2(pid=16786): stdout: | (launched: 2022-12-14_06:18:57.338154) 06:19:00.717581 run osmo-hlr_10.42.42.2(pid=16786): stderr: | 20221214061857515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061857515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061857516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061857516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061857516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061857516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061857546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061857555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061857555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061857555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:00.768129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16775): Terminating (SIGTERM) 06:19:00.808873 run iperf3-srv_10.42.42.10(pid=16776): Terminating (SIGTERM) 06:19:00.861056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16777): Terminating (SIGTERM) 06:19:00.915572 run iperf3-srv_10.42.42.10(pid=16778): Terminating (SIGTERM) 06:19:00.974414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16779): Terminating (SIGTERM) 06:19:01.016005 run iperf3-srv_10.42.42.10(pid=16780): Terminating (SIGTERM) 06:19:01.066836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16781): Terminating (SIGTERM) 06:19:01.108815 run iperf3-srv_10.42.42.10(pid=16782): Terminating (SIGTERM) 06:19:01.151919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16785): Terminating (SIGTERM) 06:19:01.194763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16788): Terminating (SIGTERM) 06:19:01.237399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16791): Terminating (SIGTERM) 06:19:01.279917 --- ParallelTerminationStrategy: PID 16775 died... 06:19:01.300111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16775): Terminated: ok {rc=0} 06:19:01.347071 --- ParallelTerminationStrategy: PID 16776 died... 06:19:01.367413 run iperf3-srv_10.42.42.10(pid=16776): Terminated {rc=256} 06:19:01.414058 --- ParallelTerminationStrategy: PID 16777 died... 06:19:01.434326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16777): Terminated: ok {rc=0} 06:19:01.481234 --- ParallelTerminationStrategy: PID 16778 died... 06:19:01.501370 run iperf3-srv_10.42.42.10(pid=16778): Terminated {rc=256} 06:19:01.548070 --- ParallelTerminationStrategy: PID 16779 died... 06:19:01.568113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16779): Terminated: ok {rc=0} 06:19:01.613817 --- ParallelTerminationStrategy: PID 16780 died... 06:19:01.633745 run iperf3-srv_10.42.42.10(pid=16780): Terminated {rc=256} 06:19:01.679372 --- ParallelTerminationStrategy: PID 16781 died... 06:19:01.699257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16781): Terminated: ok {rc=0} 06:19:01.744434 --- ParallelTerminationStrategy: PID 16782 died... 06:19:01.764229 run iperf3-srv_10.42.42.10(pid=16782): Terminated {rc=256} 06:19:01.809987 --- ParallelTerminationStrategy: PID 16785 died... 06:19:01.829811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16785): Terminated: ok {rc=0} 06:19:01.876019 --- ParallelTerminationStrategy: PID 16788 died... 06:19:01.896058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16788): Terminated: ok {rc=0} 06:19:01.941662 --- ParallelTerminationStrategy: PID 16791 died... 06:19:01.961426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16791): Terminated: ok {rc=0} 06:19:02.053813 bus /gobi_4: Setting Powered False 06:19:03.159643 bus /gobi_4: Setting Powered False 06:19:04.275771 bus /gobi_1: Setting Powered False 06:19:05.377251 bus /gobi_1: Setting Powered False 06:19:06.494624 bus /gobi_0: Setting Powered False 06:19:07.594403 bus /gobi_0: Setting Powered False 06:19:08.712423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 06:19:09.816335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:09.827840 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:19:09.878853 tst ping.py: using LAC 38989 06:19:10.008118 tst ping.py: using RAC 229 06:19:10.137737 tst ping.py: using CellId 38989 06:19:10.266605 tst ping.py: using BVCI 38990 06:19:10.387923 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.399411 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.410625 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.421821 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.433059 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.444219 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.455618 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:10.466828 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:19:10.583351 tst ping.py:19: start network... 06:19:10.789924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:11.265977 run create_hlr_db(pid=16795): Launched 06:19:11.383639 bus /gobi_6: Setting Powered False 06:19:12.444514 run create_hlr_db(pid=16795): Terminated: ok {rc=0} 06:19:12.892294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16797): Launched 06:19:13.220029 run osmo-hlr_10.42.42.2(pid=16798): Launched 06:19:13.345974 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:13.914360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16800): Launched 06:19:14.242560 run osmo-stp_10.42.42.5(pid=16801): Launched 06:19:14.368921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:14.935153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16803): Launched 06:19:15.060096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:15.338127 run patchelf(pid=16804): Launched 06:19:15.519749 run osmo-stp_10.42.42.5(pid=16801): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16801)] 06:19:15.658535 run osmo-stp_10.42.42.5(pid=16801): stdout: | (launched: 2022-12-14_06:19:14.182155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:15.798990 run osmo-stp_10.42.42.5(pid=16801): stderr: | 20221214061914376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061914376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061914377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061914377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061914378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061914378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061914378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:15.960363 run osmo-stp_10.42.42.5(pid=16801): stdout: | (launched: 2022-12-14_06:19:14.182155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:16.100590 run osmo-stp_10.42.42.5(pid=16801): stderr: | 20221214061914376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061914376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061914377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061914377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061914378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061914378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061914378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:16.262581 run patchelf(pid=16804): Terminating (SIGINT) 06:19:16.450687 run patchelf(pid=16804): Terminated: ok {rc=0} 06:19:16.585650 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16801): Process ended prematurely: osmo-stp_10.42.42.5(pid=16801) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16801)] [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 06:19:16.596426 tst ping.py:22: Test FAILED (6.8 sec) 06:19:16.626602 run osmo-hlr_10.42.42.2(pid=16798): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16798)] 06:19:16.679028 run osmo-hlr_10.42.42.2(pid=16798): stdout: | (launched: 2022-12-14_06:19:13.159689) 06:19:16.732505 run osmo-hlr_10.42.42.2(pid=16798): stderr: | 20221214061913359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061913359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061913359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061913359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061913359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061913359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061913372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061913380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061913380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061913380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:16.786539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16797): Terminating (SIGTERM) 06:19:16.830138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16800): Terminating (SIGTERM) 06:19:16.873646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16803): Terminating (SIGTERM) 06:19:16.917217 --- ParallelTerminationStrategy: PID 16797 died... 06:19:16.937955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16797): Terminated: ok {rc=0} 06:19:16.987290 --- ParallelTerminationStrategy: PID 16800 died... 06:19:17.008726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16800): Terminated: ok {rc=0} 06:19:17.056873 --- ParallelTerminationStrategy: PID 16803 died... 06:19:17.078262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16803): Terminated: ok {rc=0} 06:19:17.173809 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:19:18.263075 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.275041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:19:18.328487 tst ping_idle_ping.py: using LAC 38990 06:19:18.458754 tst ping_idle_ping.py: using RAC 230 06:19:18.588865 tst ping_idle_ping.py: using CellId 38990 06:19:18.716738 tst ping_idle_ping.py: using BVCI 38991 06:19:18.836064 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.847524 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.858730 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.870034 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.881112 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.892238 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.903564 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:19:18.914737 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:19:19.034270 tst ping_idle_ping.py:24: start network... 06:19:19.256252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:19.767673 run create_hlr_db(pid=16805): Launched 06:19:19.901393 bus /gobi_6: Setting Powered False 06:19:20.966956 run create_hlr_db(pid=16805): Terminated: ok {rc=0} 06:19:21.416860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16807): Launched 06:19:21.745239 run osmo-hlr_10.42.42.2(pid=16808): Launched 06:19:21.870423 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:22.441019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16810): Launched 06:19:22.769414 run osmo-stp_10.42.42.5(pid=16811): Launched 06:19:22.894198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:23.459833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16813): Launched 06:19:23.584761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:23.862255 run patchelf(pid=16814): Launched 06:19:24.043884 run osmo-stp_10.42.42.5(pid=16811): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16811)] 06:19:24.182059 run osmo-stp_10.42.42.5(pid=16811): stdout: | (launched: 2022-12-14_06:19:22.708707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:24.322862 run osmo-stp_10.42.42.5(pid=16811): stderr: | 20221214061922904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061922904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061922904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061922905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061922905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061922905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061922905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:24.464049 run osmo-stp_10.42.42.5(pid=16811): stdout: | (launched: 2022-12-14_06:19:22.708707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:24.597727 run osmo-stp_10.42.42.5(pid=16811): stderr: | 20221214061922904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061922904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061922904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061922905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061922905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061922905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061922905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:24.756258 run patchelf(pid=16814): Terminating (SIGINT) 06:19:24.938979 run patchelf(pid=16814): Terminated: ok {rc=0} 06:19:25.071031 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16811): Process ended prematurely: osmo-stp_10.42.42.5(pid=16811) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16811)] [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 06:19:25.080624 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:19:25.108863 run osmo-hlr_10.42.42.2(pid=16808): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16808)] 06:19:25.158748 run osmo-hlr_10.42.42.2(pid=16808): stdout: | (launched: 2022-12-14_06:19:21.684717) 06:19:25.211043 run osmo-hlr_10.42.42.2(pid=16808): stderr: | 20221214061921886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061921886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061921886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061921886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061921886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061921886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061921899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061921908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061921908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061921908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:25.263172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16807): Terminating (SIGTERM) 06:19:25.305221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16810): Terminating (SIGTERM) 06:19:25.347033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16813): Terminating (SIGTERM) 06:19:25.389557 --- ParallelTerminationStrategy: PID 16807 died... 06:19:25.409766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16807): Terminated: ok {rc=0} 06:19:25.456095 --- ParallelTerminationStrategy: PID 16810 died... 06:19:25.476161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16810): Terminated: ok {rc=0} 06:19:25.522844 --- ParallelTerminationStrategy: PID 16813 died... 06:19:25.542693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16813): Terminated: ok {rc=0} 06:19:25.631483 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:19:26.930028 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:19:26.936232 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:19:26.968690 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:19:27.008824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:19:27.096343 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:19:27.129354 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:19:27.168141 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:19:27.759856 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:19:27.811945 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:27.822967 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:19:27.914961 tst cs_paging_gprs_active.py: using LAC 38991 06:19:28.037416 tst cs_paging_gprs_active.py: using RAC 231 06:19:28.172135 tst cs_paging_gprs_active.py: using CellId 38991 06:19:28.303554 tst cs_paging_gprs_active.py: using BVCI 38992 06:19:28.426159 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.437674 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.448843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.460091 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.471265 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.482602 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.493981 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.505159 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:28.516452 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:28.636116 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:28.756353 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:19:28.983121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:29.320358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16819): Launched 06:19:29.612515 run iperf3-srv_10.42.42.10(pid=16820): Launched 06:19:29.737916 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:19:29.964029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:30.300484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16821): Launched 06:19:30.593269 run iperf3-srv_10.42.42.10(pid=16822): Launched 06:19:30.718104 tst cs_paging_gprs_active.py:38: start network... 06:19:30.956591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:31.490103 run create_hlr_db(pid=16823): Launched 06:19:31.657418 bus /gobi_6: Setting Powered False 06:19:32.719598 run create_hlr_db(pid=16823): Terminated: ok {rc=0} 06:19:33.195922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16825): Launched 06:19:33.530678 run osmo-hlr_10.42.42.2(pid=16826): Launched 06:19:33.657108 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:34.234225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16828): Launched 06:19:34.568749 run osmo-stp_10.42.42.5(pid=16829): Launched 06:19:34.695196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:35.270625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16831): Launched 06:19:35.398795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:35.688745 run patchelf(pid=16832): Launched 06:19:35.874588 run osmo-stp_10.42.42.5(pid=16829): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16829)] 06:19:36.016165 run osmo-stp_10.42.42.5(pid=16829): stdout: | (launched: 2022-12-14_06:19:34.507441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:36.158848 run osmo-stp_10.42.42.5(pid=16829): stderr: | 20221214061934702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061934702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061934703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061934703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061934703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061934704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061934704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:36.301639 run osmo-stp_10.42.42.5(pid=16829): stdout: | (launched: 2022-12-14_06:19:34.507441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:36.439094 run osmo-stp_10.42.42.5(pid=16829): stderr: | 20221214061934702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061934702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061934703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061934703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061934703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061934704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061934704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:36.601576 run patchelf(pid=16832): Terminating (SIGINT) 06:19:36.788322 run patchelf(pid=16832): Terminated: ok {rc=0} 06:19:36.923624 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16829): Process ended prematurely: osmo-stp_10.42.42.5(pid=16829) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16829)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:19:36.934003 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 06:19:36.962863 run osmo-hlr_10.42.42.2(pid=16826): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16826)] 06:19:37.013400 run osmo-hlr_10.42.42.2(pid=16826): stdout: | (launched: 2022-12-14_06:19:33.469112) 06:19:37.065496 run osmo-hlr_10.42.42.2(pid=16826): stderr: | 20221214061933669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061933669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061933669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061933669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061933669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061933669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061933681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061933692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061933692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061933692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:37.118125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16819): Terminating (SIGTERM) 06:19:37.160393 run iperf3-srv_10.42.42.10(pid=16820): Terminating (SIGTERM) 06:19:37.202616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16821): Terminating (SIGTERM) 06:19:37.244849 run iperf3-srv_10.42.42.10(pid=16822): Terminating (SIGTERM) 06:19:37.287302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16825): Terminating (SIGTERM) 06:19:37.329912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16828): Terminating (SIGTERM) 06:19:37.371944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16831): Terminating (SIGTERM) 06:19:37.414280 --- ParallelTerminationStrategy: PID 16819 died... 06:19:37.434558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16819): Terminated: ok {rc=0} 06:19:37.481265 --- ParallelTerminationStrategy: PID 16820 died... 06:19:37.501375 run iperf3-srv_10.42.42.10(pid=16820): Terminated {rc=256} 06:19:37.547718 --- ParallelTerminationStrategy: PID 16821 died... 06:19:37.567478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16821): Terminated: ok {rc=0} 06:19:37.613915 --- ParallelTerminationStrategy: PID 16822 died... 06:19:37.633739 run iperf3-srv_10.42.42.10(pid=16822): Terminated {rc=256} 06:19:37.680059 --- ParallelTerminationStrategy: PID 16825 died... 06:19:37.699919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16825): Terminated: ok {rc=0} 06:19:37.746192 --- ParallelTerminationStrategy: PID 16828 died... 06:19:37.766051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16828): Terminated: ok {rc=0} 06:19:37.812209 --- ParallelTerminationStrategy: PID 16831 died... 06:19:37.832025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16831): Terminated: ok {rc=0} 06:19:37.919923 bus /gobi_0: Setting Powered False 06:19:39.019571 bus /gobi_0: Setting Powered False 06:19:40.135374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:19:41.280365 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.292019 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:19:41.362412 tst iperf3.py: using LAC 38992 06:19:41.490219 tst iperf3.py: using RAC 232 06:19:41.610795 tst iperf3.py: using CellId 38992 06:19:41.733196 tst iperf3.py: using BVCI 38993 06:19:41.847001 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.858246 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.869217 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.879873 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.891127 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.902202 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.913798 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.924820 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:41.936038 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:42.056707 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:19:42.283487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:42.620918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16833): Launched 06:19:42.911608 run iperf3-srv_10.42.42.10(pid=16834): Launched 06:19:43.036166 tst iperf3.py:8: start network... 06:19:43.262716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:43.781714 run create_hlr_db(pid=16835): Launched 06:19:43.916343 bus /gobi_6: Setting Powered False 06:19:44.982336 run create_hlr_db(pid=16835): Terminated: ok {rc=0} 06:19:45.447546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16837): Launched 06:19:45.781047 run osmo-hlr_10.42.42.2(pid=16838): Launched 06:19:45.913794 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:46.641542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16840): Launched 06:19:46.987263 run osmo-stp_10.42.42.5(pid=16841): Launched 06:19:47.281380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:47.858445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16843): Launched 06:19:47.985916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:48.268353 run patchelf(pid=16844): Launched 06:19:48.456269 run osmo-stp_10.42.42.5(pid=16841): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16841)] 06:19:48.597887 run osmo-stp_10.42.42.5(pid=16841): stdout: | (launched: 2022-12-14_06:19:46.920743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:48.741072 run osmo-stp_10.42.42.5(pid=16841): stderr: | 20221214061947108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061947108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061947108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061947109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061947109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061947109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061947109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:48.884422 run osmo-stp_10.42.42.5(pid=16841): stdout: | (launched: 2022-12-14_06:19:46.920743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:49.021192 run osmo-stp_10.42.42.5(pid=16841): stderr: | 20221214061947108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214061947108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214061947108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214061947109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214061947109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214061947109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214061947109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:49.183098 run patchelf(pid=16844): Terminating (SIGINT) 06:19:49.370503 run patchelf(pid=16844): Terminated: ok {rc=0} 06:19:49.505277 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16841): Process ended prematurely: osmo-stp_10.42.42.5(pid=16841) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16841)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 06:19:49.515510 tst iperf3.py:8: Test FAILED (8.3 sec) 06:19:49.544432 run osmo-hlr_10.42.42.2(pid=16838): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16838)] 06:19:49.595101 run osmo-hlr_10.42.42.2(pid=16838): stdout: | (launched: 2022-12-14_06:19:45.719898) 06:19:49.647552 run osmo-hlr_10.42.42.2(pid=16838): stderr: | 20221214061945988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061945988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061945988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061945988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061945988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061945988 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061946017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061946038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061946038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061946038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:49.700386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16833): Terminating (SIGTERM) 06:19:49.743141 run iperf3-srv_10.42.42.10(pid=16834): Terminating (SIGTERM) 06:19:49.785768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16837): Terminating (SIGTERM) 06:19:49.828108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16840): Terminating (SIGTERM) 06:19:49.870948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16843): Terminating (SIGTERM) 06:19:49.913336 --- ParallelTerminationStrategy: PID 16833 died... 06:19:49.933679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16833): Terminated: ok {rc=0} 06:19:49.980470 --- ParallelTerminationStrategy: PID 16834 died... 06:19:50.000380 run iperf3-srv_10.42.42.10(pid=16834): Terminated {rc=256} 06:19:50.046703 --- ParallelTerminationStrategy: PID 16837 died... 06:19:50.066634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16837): Terminated: ok {rc=0} 06:19:50.113230 --- ParallelTerminationStrategy: PID 16840 died... 06:19:50.132915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16840): Terminated: ok {rc=0} 06:19:50.179691 --- ParallelTerminationStrategy: PID 16843 died... 06:19:50.199672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16843): Terminated: ok {rc=0} 06:19:50.288832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:19:51.441520 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:51.453865 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:19:51.525657 tst iperf3m4.py: using LAC 38993 06:19:51.655742 tst iperf3m4.py: using RAC 233 06:19:51.788328 tst iperf3m4.py: using CellId 38993 06:19:51.911388 tst iperf3m4.py: using BVCI 38994 06:19:52.026465 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.037683 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.048540 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.059569 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.070580 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.081578 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.092413 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.103247 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:52.114287 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:52.235652 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:52.360546 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:52.480489 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:52.604603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:19:52.831343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:53.170389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16846): Launched 06:19:53.464413 run iperf3-srv_10.42.42.10(pid=16847): Launched 06:19:53.589631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:19:53.815580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:54.152591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16848): Launched 06:19:54.443852 run iperf3-srv_10.42.42.10(pid=16849): Launched 06:19:54.568781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:19:54.794462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:55.130974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16850): Launched 06:19:55.423191 run iperf3-srv_10.42.42.10(pid=16851): Launched 06:19:55.549358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:19:55.774182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:56.111010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16852): Launched 06:19:56.402699 run iperf3-srv_10.42.42.10(pid=16853): Launched 06:19:56.527397 tst iperf3m4.py:8: start network... 06:19:56.753458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:57.273037 run create_hlr_db(pid=16854): Launched 06:19:57.407756 bus /gobi_6: Setting Powered False 06:19:58.472925 run create_hlr_db(pid=16854): Terminated: ok {rc=0} 06:19:58.920130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16856): Launched 06:19:59.234931 run osmo-hlr_10.42.42.2(pid=16857): Launched 06:19:59.354296 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:59.905549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16859): Launched 06:20:00.218825 run osmo-stp_10.42.42.5(pid=16860): Launched 06:20:00.337636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:00.893522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16862): Launched 06:20:01.044363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:01.344108 run patchelf(pid=16866): Launched 06:20:01.546068 run osmo-stp_10.42.42.5(pid=16860): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16860)] 06:20:01.708353 run osmo-stp_10.42.42.5(pid=16860): stdout: | (launched: 2022-12-14_06:20:00.160633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:01.868583 run osmo-stp_10.42.42.5(pid=16860): stderr: | 20221214062000332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062000332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062000332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062000333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062000333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062000333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062000333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:02.015179 run osmo-stp_10.42.42.5(pid=16860): stdout: | (launched: 2022-12-14_06:20:00.160633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:02.156075 run osmo-stp_10.42.42.5(pid=16860): stderr: | 20221214062000332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062000332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062000332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062000333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062000333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062000333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062000333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:02.319264 run patchelf(pid=16866): Terminating (SIGINT) 06:20:02.506273 run patchelf(pid=16866): Terminated: ok {rc=0} 06:20:02.640783 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16860): Process ended prematurely: osmo-stp_10.42.42.5(pid=16860) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16860)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:20:02.651399 tst iperf3m4.py:8: Test FAILED (11.2 sec) 06:20:02.680586 run osmo-hlr_10.42.42.2(pid=16857): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16857)] 06:20:02.730495 run osmo-hlr_10.42.42.2(pid=16857): stdout: | (launched: 2022-12-14_06:19:59.176843) 06:20:02.782445 run osmo-hlr_10.42.42.2(pid=16857): stderr: | 20221214061959355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214061959355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214061959355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214061959355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214061959355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214061959355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214061959371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214061959381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214061959381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214061959381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:02.834804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16846): Terminating (SIGTERM) 06:20:02.876896 run iperf3-srv_10.42.42.10(pid=16847): Terminating (SIGTERM) 06:20:02.919363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16848): Terminating (SIGTERM) 06:20:02.961931 run iperf3-srv_10.42.42.10(pid=16849): Terminating (SIGTERM) 06:20:03.004292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16850): Terminating (SIGTERM) 06:20:03.048583 run iperf3-srv_10.42.42.10(pid=16851): Terminating (SIGTERM) 06:20:03.089804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16852): Terminating (SIGTERM) 06:20:03.130554 run iperf3-srv_10.42.42.10(pid=16853): Terminating (SIGTERM) 06:20:03.171294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16856): Terminating (SIGTERM) 06:20:03.212169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16859): Terminating (SIGTERM) 06:20:03.252891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16862): Terminating (SIGTERM) 06:20:03.294025 --- ParallelTerminationStrategy: PID 16846 died... 06:20:03.313680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16846): Terminated: ok {rc=0} 06:20:03.359315 --- ParallelTerminationStrategy: PID 16847 died... 06:20:03.379160 run iperf3-srv_10.42.42.10(pid=16847): Terminated {rc=256} 06:20:03.424515 --- ParallelTerminationStrategy: PID 16848 died... 06:20:03.444261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16848): Terminated: ok {rc=0} 06:20:03.489601 --- ParallelTerminationStrategy: PID 16849 died... 06:20:03.509279 run iperf3-srv_10.42.42.10(pid=16849): Terminated {rc=256} 06:20:03.554498 --- ParallelTerminationStrategy: PID 16850 died... 06:20:03.574315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16850): Terminated: ok {rc=0} 06:20:03.619682 --- ParallelTerminationStrategy: PID 16851 died... 06:20:03.639328 run iperf3-srv_10.42.42.10(pid=16851): Terminated {rc=256} 06:20:03.684375 --- ParallelTerminationStrategy: PID 16852 died... 06:20:03.704083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16852): Terminated: ok {rc=0} 06:20:03.749211 --- ParallelTerminationStrategy: PID 16853 died... 06:20:03.768698 run iperf3-srv_10.42.42.10(pid=16853): Terminated {rc=256} 06:20:03.813750 --- ParallelTerminationStrategy: PID 16856 died... 06:20:03.833481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16856): Terminated: ok {rc=0} 06:20:03.878579 --- ParallelTerminationStrategy: PID 16859 died... 06:20:03.898270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16859): Terminated: ok {rc=0} 06:20:03.943474 --- ParallelTerminationStrategy: PID 16862 died... 06:20:03.963253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16862): Terminated: ok {rc=0} 06:20:04.052160 bus /gobi_4: Setting Powered False 06:20:05.153566 bus /gobi_4: Setting Powered False 06:20:06.269135 bus /gobi_1: Setting Powered False 06:20:07.368525 bus /gobi_1: Setting Powered False 06:20:08.485120 bus /gobi_0: Setting Powered False 06:20:09.583993 bus /gobi_0: Setting Powered False 06:20:10.702047 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:20:11.807087 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:11.819519 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:20:11.892027 tst ping.py: using LAC 38994 06:20:12.022524 tst ping.py: using RAC 234 06:20:12.153854 tst ping.py: using CellId 38994 06:20:12.275069 tst ping.py: using BVCI 38995 06:20:12.386826 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.398018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.408783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.419667 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.430824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.441997 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.453115 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:12.464027 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:20:12.583854 tst ping.py:19: start network... 06:20:12.806232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:13.313836 run create_hlr_db(pid=16868): Launched 06:20:13.431432 bus /gobi_6: Setting Powered False 06:20:14.492555 run create_hlr_db(pid=16868): Terminated: ok {rc=0} 06:20:14.941621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16870): Launched 06:20:15.270552 run osmo-hlr_10.42.42.2(pid=16871): Launched 06:20:15.397169 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:15.986929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16873): Launched 06:20:16.328592 run osmo-stp_10.42.42.5(pid=16874): Launched 06:20:16.548341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:17.174636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16876): Launched 06:20:17.310775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:17.589581 run patchelf(pid=16877): Launched 06:20:17.771607 run osmo-stp_10.42.42.5(pid=16874): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16874)] 06:20:17.910020 run osmo-stp_10.42.42.5(pid=16874): stdout: | (launched: 2022-12-14_06:20:16.264721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:18.049721 run osmo-stp_10.42.42.5(pid=16874): stderr: | 20221214062016578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062016579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062016579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062016579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062016580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062016580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062016580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:18.190552 run osmo-stp_10.42.42.5(pid=16874): stdout: | (launched: 2022-12-14_06:20:16.264721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:18.324113 run osmo-stp_10.42.42.5(pid=16874): stderr: | 20221214062016578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062016579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062016579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062016579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062016580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062016580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062016580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:18.482762 run patchelf(pid=16877): Terminating (SIGINT) 06:20:18.664401 run patchelf(pid=16877): Terminated: ok {rc=0} 06:20:18.795993 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16874): Process ended prematurely: osmo-stp_10.42.42.5(pid=16874) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16874)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 06:20:18.805732 tst ping.py:22: Test FAILED (7.0 sec) 06:20:18.834058 run osmo-hlr_10.42.42.2(pid=16871): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16871)] 06:20:18.884669 run osmo-hlr_10.42.42.2(pid=16871): stdout: | (launched: 2022-12-14_06:20:15.209805) 06:20:18.937100 run osmo-hlr_10.42.42.2(pid=16871): stderr: | 20221214062015409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062015410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062015410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062015410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062015410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062015410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062015422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062015430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062015431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062015431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:18.989749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16870): Terminating (SIGTERM) 06:20:19.032210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16873): Terminating (SIGTERM) 06:20:19.075169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16876): Terminating (SIGTERM) 06:20:19.118048 --- ParallelTerminationStrategy: PID 16870 died... 06:20:19.138379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16870): Terminated: ok {rc=0} 06:20:19.185353 --- ParallelTerminationStrategy: PID 16873 died... 06:20:19.205213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16873): Terminated: ok {rc=0} 06:20:19.251861 --- ParallelTerminationStrategy: PID 16876 died... 06:20:19.271658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16876): Terminated: ok {rc=0} 06:20:19.360655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:20:20.448591 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:20.460735 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:20:20.531286 tst ping_idle_ping.py: using LAC 38995 06:20:20.659742 tst ping_idle_ping.py: using RAC 235 06:20:20.793300 tst ping_idle_ping.py: using CellId 38995 06:20:20.922517 tst ping_idle_ping.py: using BVCI 38996 06:20:21.042271 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.053829 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.064866 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.076138 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.087412 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.098719 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.110155 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:20:21.121337 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:20:21.243697 tst ping_idle_ping.py:24: start network... 06:20:21.463659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:21.968935 run create_hlr_db(pid=16878): Launched 06:20:22.099878 bus /gobi_6: Setting Powered False 06:20:23.160556 run create_hlr_db(pid=16878): Terminated: ok {rc=0} 06:20:23.596005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16880): Launched 06:20:23.899882 run osmo-hlr_10.42.42.2(pid=16881): Launched 06:20:24.015999 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:24.555250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16883): Launched 06:20:24.859614 run osmo-stp_10.42.42.5(pid=16884): Launched 06:20:24.975445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:25.499627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16886): Launched 06:20:25.616307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:25.873623 run patchelf(pid=16887): Launched 06:20:26.042261 run osmo-stp_10.42.42.5(pid=16884): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16884)] 06:20:26.171410 run osmo-stp_10.42.42.5(pid=16884): stdout: | (launched: 2022-12-14_06:20:24.802804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:26.302368 run osmo-stp_10.42.42.5(pid=16884): stderr: | 20221214062024972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062024972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062024972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062024973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062024973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062024973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062024974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:26.432696 run osmo-stp_10.42.42.5(pid=16884): stdout: | (launched: 2022-12-14_06:20:24.802804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:26.556628 run osmo-stp_10.42.42.5(pid=16884): stderr: | 20221214062024972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062024972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062024972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062024973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062024973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062024973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062024974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:26.703739 run patchelf(pid=16887): Terminating (SIGINT) 06:20:26.873836 run patchelf(pid=16887): Terminated: ok {rc=0} 06:20:26.996100 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16884): Process ended prematurely: osmo-stp_10.42.42.5(pid=16884) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16884)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:20:27.005516 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:20:27.031900 run osmo-hlr_10.42.42.2(pid=16881): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16881)] 06:20:27.079487 run osmo-hlr_10.42.42.2(pid=16881): stdout: | (launched: 2022-12-14_06:20:23.843160) 06:20:27.128259 run osmo-hlr_10.42.42.2(pid=16881): stderr: | 20221214062024019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062024020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062024020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062024020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062024020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062024020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062024032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062024040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062024041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062024041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:27.177421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16880): Terminating (SIGTERM) 06:20:27.217415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16883): Terminating (SIGTERM) 06:20:27.257201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16886): Terminating (SIGTERM) 06:20:27.297231 --- ParallelTerminationStrategy: PID 16880 died... 06:20:27.316435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16880): Terminated: ok {rc=0} 06:20:27.360632 --- ParallelTerminationStrategy: PID 16883 died... 06:20:27.379703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16883): Terminated: ok {rc=0} 06:20:27.423630 --- ParallelTerminationStrategy: PID 16886 died... 06:20:27.442567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16886): Terminated: ok {rc=0} 06:20:27.528282 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:20:28.828215 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:28.834268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:20:28.866812 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:20:28.906261 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:20:28.993142 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:20:29.025432 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:20:29.063729 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:20:29.655594 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:20:29.706665 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:29.717482 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:20:29.787846 tst cs_paging_gprs_active.py: using LAC 38996 06:20:29.911386 tst cs_paging_gprs_active.py: using RAC 236 06:20:30.038180 tst cs_paging_gprs_active.py: using CellId 38996 06:20:30.168348 tst cs_paging_gprs_active.py: using BVCI 38997 06:20:30.288386 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.299931 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.311186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.322561 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.333747 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.345312 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.356462 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.367492 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:30.378796 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:30.501266 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:30.624607 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:20:30.841555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:31.183042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16892): Launched 06:20:31.480108 run iperf3-srv_10.42.42.10(pid=16893): Launched 06:20:31.608876 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:20:31.820174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:32.145651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16894): Launched 06:20:32.420224 run iperf3-srv_10.42.42.10(pid=16895): Launched 06:20:32.535555 tst cs_paging_gprs_active.py:38: start network... 06:20:32.741599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:33.218369 run create_hlr_db(pid=16896): Launched 06:20:33.353271 bus /gobi_6: Setting Powered False 06:20:34.417277 run create_hlr_db(pid=16896): Terminated: ok {rc=0} 06:20:34.872564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16898): Launched 06:20:35.201052 run osmo-hlr_10.42.42.2(pid=16899): Launched 06:20:35.325764 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:35.894130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16901): Launched 06:20:36.222336 run osmo-stp_10.42.42.5(pid=16902): Launched 06:20:36.347502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:36.914697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16904): Launched 06:20:37.040443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:37.318334 run patchelf(pid=16905): Launched 06:20:37.502572 run osmo-stp_10.42.42.5(pid=16902): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16902)] 06:20:37.641891 run osmo-stp_10.42.42.5(pid=16902): stdout: | (launched: 2022-12-14_06:20:36.162441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:37.782900 run osmo-stp_10.42.42.5(pid=16902): stderr: | 20221214062036353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062036353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062036354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062036354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062036355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062036355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062036355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:37.924226 run osmo-stp_10.42.42.5(pid=16902): stdout: | (launched: 2022-12-14_06:20:36.162441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:38.058751 run osmo-stp_10.42.42.5(pid=16902): stderr: | 20221214062036353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062036353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062036354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062036354 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062036355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062036355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062036355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:38.218224 run patchelf(pid=16905): Terminating (SIGINT) 06:20:38.402584 run patchelf(pid=16905): Terminated: ok {rc=0} 06:20:38.534718 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16902): Process ended prematurely: osmo-stp_10.42.42.5(pid=16902) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16902)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:20:38.544832 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:20:38.573336 run osmo-hlr_10.42.42.2(pid=16899): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16899)] 06:20:38.623301 run osmo-hlr_10.42.42.2(pid=16899): stdout: | (launched: 2022-12-14_06:20:35.141099) 06:20:38.674894 run osmo-hlr_10.42.42.2(pid=16899): stderr: | 20221214062035338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062035338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062035338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062035338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062035338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062035338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062035352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062035361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062035362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062035362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:38.727299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16892): Terminating (SIGTERM) 06:20:38.769115 run iperf3-srv_10.42.42.10(pid=16893): Terminating (SIGTERM) 06:20:38.811104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16894): Terminating (SIGTERM) 06:20:38.852639 run iperf3-srv_10.42.42.10(pid=16895): Terminating (SIGTERM) 06:20:38.894724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16898): Terminating (SIGTERM) 06:20:38.936610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16901): Terminating (SIGTERM) 06:20:38.978391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16904): Terminating (SIGTERM) 06:20:39.020763 --- ParallelTerminationStrategy: PID 16892 died... 06:20:39.040589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16892): Terminated: ok {rc=0} 06:20:39.086787 --- ParallelTerminationStrategy: PID 16893 died... 06:20:39.106267 run iperf3-srv_10.42.42.10(pid=16893): Terminated {rc=256} 06:20:39.152017 --- ParallelTerminationStrategy: PID 16894 died... 06:20:39.171601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16894): Terminated: ok {rc=0} 06:20:39.217926 --- ParallelTerminationStrategy: PID 16895 died... 06:20:39.237409 run iperf3-srv_10.42.42.10(pid=16895): Terminated {rc=256} 06:20:39.283169 --- ParallelTerminationStrategy: PID 16898 died... 06:20:39.302704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16898): Terminated: ok {rc=0} 06:20:39.349017 --- ParallelTerminationStrategy: PID 16901 died... 06:20:39.368472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16901): Terminated: ok {rc=0} 06:20:39.414405 --- ParallelTerminationStrategy: PID 16904 died... 06:20:39.433922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16904): Terminated: ok {rc=0} 06:20:39.520146 bus /gobi_0: Setting Powered False 06:20:40.618606 bus /gobi_0: Setting Powered False 06:20:41.734926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:20:42.884720 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:42.896418 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:20:42.967712 tst iperf3.py: using LAC 38997 06:20:43.099693 tst iperf3.py: using RAC 237 06:20:43.228569 tst iperf3.py: using CellId 38997 06:20:43.356309 tst iperf3.py: using BVCI 38998 06:20:43.468417 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.479473 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.490281 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.501000 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.512190 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.523627 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.534638 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.545477 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:43.556243 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:43.671826 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:20:43.896185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:44.225265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16906): Launched 06:20:44.511078 run iperf3-srv_10.42.42.10(pid=16907): Launched 06:20:44.633564 tst iperf3.py:8: start network... 06:20:44.854302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:45.362861 run create_hlr_db(pid=16908): Launched 06:20:45.495313 bus /gobi_6: Setting Powered False 06:20:46.592711 run create_hlr_db(pid=16908): Terminated: ok {rc=0} 06:20:47.065526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16910): Launched 06:20:47.390236 run osmo-hlr_10.42.42.2(pid=16911): Launched 06:20:47.508200 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:48.055085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16913): Launched 06:20:48.361503 run osmo-stp_10.42.42.5(pid=16914): Launched 06:20:48.478109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:49.005873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16916): Launched 06:20:49.123684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:49.383525 run patchelf(pid=16917): Launched 06:20:49.554403 run osmo-stp_10.42.42.5(pid=16914): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16914)] 06:20:49.684465 run osmo-stp_10.42.42.5(pid=16914): stdout: | (launched: 2022-12-14_06:20:48.305349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:49.815696 run osmo-stp_10.42.42.5(pid=16914): stderr: | 20221214062048473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062048473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062048473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062048473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062048474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062048474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062048474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:49.947286 run osmo-stp_10.42.42.5(pid=16914): stdout: | (launched: 2022-12-14_06:20:48.305349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:50.072615 run osmo-stp_10.42.42.5(pid=16914): stderr: | 20221214062048473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062048473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062048473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062048473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062048474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062048474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062048474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:50.221455 run patchelf(pid=16917): Terminating (SIGINT) 06:20:50.393783 run patchelf(pid=16917): Terminated: ok {rc=0} 06:20:50.517958 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16914): Process ended prematurely: osmo-stp_10.42.42.5(pid=16914) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16914)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 06:20:50.527272 tst iperf3.py:8: Test FAILED (7.7 sec) 06:20:50.554384 run osmo-hlr_10.42.42.2(pid=16911): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16911)] 06:20:50.602243 run osmo-hlr_10.42.42.2(pid=16911): stdout: | (launched: 2022-12-14_06:20:47.333742) 06:20:50.651484 run osmo-hlr_10.42.42.2(pid=16911): stderr: | 20221214062047509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062047509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062047509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062047510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062047510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062047510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062047522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062047532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062047532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062047533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:50.701219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16906): Terminating (SIGTERM) 06:20:50.741324 run iperf3-srv_10.42.42.10(pid=16907): Terminating (SIGTERM) 06:20:50.781150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16910): Terminating (SIGTERM) 06:20:50.820888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16913): Terminating (SIGTERM) 06:20:50.860766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16916): Terminating (SIGTERM) 06:20:50.900898 --- ParallelTerminationStrategy: PID 16906 died... 06:20:50.920548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16906): Terminated: ok {rc=0} 06:20:50.964902 --- ParallelTerminationStrategy: PID 16907 died... 06:20:50.983769 run iperf3-srv_10.42.42.10(pid=16907): Terminated {rc=256} 06:20:51.028259 --- ParallelTerminationStrategy: PID 16910 died... 06:20:51.047595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16910): Terminated: ok {rc=0} 06:20:51.091793 --- ParallelTerminationStrategy: PID 16913 died... 06:20:51.110642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16913): Terminated: ok {rc=0} 06:20:51.154643 --- ParallelTerminationStrategy: PID 16916 died... 06:20:51.173678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16916): Terminated: ok {rc=0} 06:20:51.257063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:20:52.401953 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:52.413445 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:20:52.485178 tst iperf3m4.py: using LAC 38998 06:20:52.605173 tst iperf3m4.py: using RAC 238 06:20:52.725251 tst iperf3m4.py: using CellId 38998 06:20:52.845882 tst iperf3m4.py: using BVCI 38999 06:20:52.957503 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:52.968340 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:52.979093 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:52.989745 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:53.001189 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:53.012621 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:53.024268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:53.035948 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:53.048631 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:53.168320 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:53.287121 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:53.402943 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:53.519201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:20:53.725853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:54.034320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16918): Launched 06:20:54.302318 run iperf3-srv_10.42.42.10(pid=16919): Launched 06:20:54.417440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:20:54.623041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:54.931885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16920): Launched 06:20:55.201181 run iperf3-srv_10.42.42.10(pid=16921): Launched 06:20:55.315865 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:20:55.520836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:55.829251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16922): Launched 06:20:56.096350 run iperf3-srv_10.42.42.10(pid=16923): Launched 06:20:56.211143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:20:56.415978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:20:56.724360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16924): Launched 06:20:56.991752 run iperf3-srv_10.42.42.10(pid=16925): Launched 06:20:57.107398 tst iperf3m4.py:8: start network... 06:20:57.311499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:57.786597 run create_hlr_db(pid=16926): Launched 06:20:57.917734 bus /gobi_6: Setting Powered False 06:20:58.981737 run create_hlr_db(pid=16926): Terminated: ok {rc=0} 06:20:59.437597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16928): Launched 06:20:59.764521 run osmo-hlr_10.42.42.2(pid=16929): Launched 06:20:59.888023 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:00.450845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16931): Launched 06:21:00.779243 run osmo-stp_10.42.42.5(pid=16932): Launched 06:21:01.027972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:21:01.663722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16934): Launched 06:21:01.797417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:21:02.073291 run patchelf(pid=16935): Launched 06:21:02.261227 run osmo-stp_10.42.42.5(pid=16932): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16932)] 06:21:02.403564 run osmo-stp_10.42.42.5(pid=16932): stdout: | (launched: 2022-12-14_06:21:00.719267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:02.534867 run osmo-stp_10.42.42.5(pid=16932): stderr: | 20221214062100928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062100928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062100929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062100930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062100931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062100931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062100932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:02.666697 run osmo-stp_10.42.42.5(pid=16932): stdout: | (launched: 2022-12-14_06:21:00.719267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:02.791967 run osmo-stp_10.42.42.5(pid=16932): stderr: | 20221214062100928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062100928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062100929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062100930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062100931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062100931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062100932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:02.940502 run patchelf(pid=16935): Terminating (SIGINT) 06:21:03.112896 run patchelf(pid=16935): Terminated: ok {rc=0} 06:21:03.237930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16932): Process ended prematurely: osmo-stp_10.42.42.5(pid=16932) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16932)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:21:03.247538 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:21:03.275062 run osmo-hlr_10.42.42.2(pid=16929): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16929)] 06:21:03.323245 run osmo-hlr_10.42.42.2(pid=16929): stdout: | (launched: 2022-12-14_06:20:59.704685) 06:21:03.373198 run osmo-hlr_10.42.42.2(pid=16929): stderr: | 20221214062059899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062059900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062059900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062059900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062059900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062059900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062059913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062059922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062059922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062059922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:03.423037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16918): Terminating (SIGTERM) 06:21:03.462969 run iperf3-srv_10.42.42.10(pid=16919): Terminating (SIGTERM) 06:21:03.502899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16920): Terminating (SIGTERM) 06:21:03.542766 run iperf3-srv_10.42.42.10(pid=16921): Terminating (SIGTERM) 06:21:03.582728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16922): Terminating (SIGTERM) 06:21:03.622495 run iperf3-srv_10.42.42.10(pid=16923): Terminating (SIGTERM) 06:21:03.662157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16924): Terminating (SIGTERM) 06:21:03.701846 run iperf3-srv_10.42.42.10(pid=16925): Terminating (SIGTERM) 06:21:03.741518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16928): Terminating (SIGTERM) 06:21:03.781199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16931): Terminating (SIGTERM) 06:21:03.821174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16934): Terminating (SIGTERM) 06:21:03.861560 --- ParallelTerminationStrategy: PID 16918 died... 06:21:03.880712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16918): Terminated: ok {rc=0} 06:21:03.924844 --- ParallelTerminationStrategy: PID 16919 died... 06:21:03.943882 run iperf3-srv_10.42.42.10(pid=16919): Terminated {rc=256} 06:21:03.987892 --- ParallelTerminationStrategy: PID 16920 died... 06:21:04.006849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16920): Terminated: ok {rc=0} 06:21:04.051006 --- ParallelTerminationStrategy: PID 16921 died... 06:21:04.070011 run iperf3-srv_10.42.42.10(pid=16921): Terminated {rc=256} 06:21:04.114020 --- ParallelTerminationStrategy: PID 16922 died... 06:21:04.132898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16922): Terminated: ok {rc=0} 06:21:04.176790 --- ParallelTerminationStrategy: PID 16923 died... 06:21:04.196213 run iperf3-srv_10.42.42.10(pid=16923): Terminated {rc=256} 06:21:04.240059 --- ParallelTerminationStrategy: PID 16924 died... 06:21:04.258976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16924): Terminated: ok {rc=0} 06:21:04.303105 --- ParallelTerminationStrategy: PID 16925 died... 06:21:04.322040 run iperf3-srv_10.42.42.10(pid=16925): Terminated {rc=256} 06:21:04.365986 --- ParallelTerminationStrategy: PID 16928 died... 06:21:04.385118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16928): Terminated: ok {rc=0} 06:21:04.428916 --- ParallelTerminationStrategy: PID 16931 died... 06:21:04.447949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16931): Terminated: ok {rc=0} 06:21:04.491799 --- ParallelTerminationStrategy: PID 16934 died... 06:21:04.510756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16934): Terminated: ok {rc=0} 06:21:04.596148 bus /gobi_4: Setting Powered False 06:21:05.694974 bus /gobi_4: Setting Powered False 06:21:06.808585 bus /gobi_1: Setting Powered False 06:21:07.906319 bus /gobi_1: Setting Powered False 06:21:09.016844 bus /gobi_0: Setting Powered False 06:21:10.113834 bus /gobi_0: Setting Powered False 06:21:11.227811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:21:12.329590 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.341648 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:21:12.413388 tst ping.py: using LAC 38999 06:21:12.540101 tst ping.py: using RAC 239 06:21:12.666523 tst ping.py: using CellId 38999 06:21:12.794560 tst ping.py: using BVCI 39000 06:21:12.911990 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.923586 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.934910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.946186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.957372 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.968534 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.979887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:12.991172 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:21:13.110133 tst ping.py:19: start network... 06:21:13.329323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:13.830757 run create_hlr_db(pid=16936): Launched 06:21:13.961862 bus /gobi_6: Setting Powered False 06:21:15.026351 run create_hlr_db(pid=16936): Terminated: ok {rc=0} 06:21:15.458488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16938): Launched 06:21:15.761289 run osmo-hlr_10.42.42.2(pid=16939): Launched 06:21:15.878959 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:16.541212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16941): Launched 06:21:16.862094 run osmo-stp_10.42.42.5(pid=16942): Launched 06:21:17.176548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:21:17.711304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16944): Launched 06:21:17.827154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:21:18.083398 run patchelf(pid=16945): Launched 06:21:18.251762 run osmo-stp_10.42.42.5(pid=16942): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16942)] 06:21:18.380291 run osmo-stp_10.42.42.5(pid=16942): stdout: | (launched: 2022-12-14_06:21:16.803663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:18.510244 run osmo-stp_10.42.42.5(pid=16942): stderr: | 20221214062116995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062116995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062116996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062116996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062116997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062116997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062116997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:18.640209 run osmo-stp_10.42.42.5(pid=16942): stdout: | (launched: 2022-12-14_06:21:16.803663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:18.763810 run osmo-stp_10.42.42.5(pid=16942): stderr: | 20221214062116995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062116995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062116996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062116996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062116997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062116997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062116997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:18.910709 run patchelf(pid=16945): Terminating (SIGINT) 06:21:19.079917 run patchelf(pid=16945): Terminated: ok {rc=0} 06:21:19.202338 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16942): Process ended prematurely: osmo-stp_10.42.42.5(pid=16942) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16942)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 06:21:19.211276 tst ping.py:22: Test FAILED (6.9 sec) 06:21:19.237852 run osmo-hlr_10.42.42.2(pid=16939): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16939)] 06:21:19.285867 run osmo-hlr_10.42.42.2(pid=16939): stdout: | (launched: 2022-12-14_06:21:15.704917) 06:21:19.334731 run osmo-hlr_10.42.42.2(pid=16939): stderr: | 20221214062115966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062115966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062115966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062115966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062115966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062115966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062115983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062116005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062116005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062116005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:19.384288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16938): Terminating (SIGTERM) 06:21:19.423811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16941): Terminating (SIGTERM) 06:21:19.463347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16944): Terminating (SIGTERM) 06:21:19.503372 --- ParallelTerminationStrategy: PID 16938 died... 06:21:19.522781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16938): Terminated: ok {rc=0} 06:21:19.566611 --- ParallelTerminationStrategy: PID 16941 died... 06:21:19.585380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16941): Terminated: ok {rc=0} 06:21:19.628889 --- ParallelTerminationStrategy: PID 16944 died... 06:21:19.648106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16944): Terminated: ok {rc=0} 06:21:19.733054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:21:20.820531 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:20.832325 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:21:20.904166 tst ping_idle_ping.py: using LAC 39000 06:21:21.032798 tst ping_idle_ping.py: using RAC 240 06:21:21.159496 tst ping_idle_ping.py: using CellId 39000 06:21:21.279840 tst ping_idle_ping.py: using BVCI 39001 06:21:21.391314 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.402583 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.413670 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.424496 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.435427 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.446513 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.457685 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:21:21.468704 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:21:21.587097 tst ping_idle_ping.py:24: start network... 06:21:21.805452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:22.309751 run create_hlr_db(pid=16946): Launched 06:21:22.441803 bus /gobi_6: Setting Powered False 06:21:23.506616 run create_hlr_db(pid=16946): Terminated: ok {rc=0} 06:21:23.958346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16948): Launched 06:21:24.282397 run osmo-hlr_10.42.42.2(pid=16949): Launched 06:21:24.406737 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:24.962720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16951): Launched 06:21:25.285696 run osmo-stp_10.42.42.5(pid=16952): Launched 06:21:25.410158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:21:25.970909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16954): Launched 06:21:26.094297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:21:26.368373 run patchelf(pid=16955): Launched 06:21:26.548157 run osmo-stp_10.42.42.5(pid=16952): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16952)] 06:21:26.685048 run osmo-stp_10.42.42.5(pid=16952): stdout: | (launched: 2022-12-14_06:21:25.226443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:26.823059 run osmo-stp_10.42.42.5(pid=16952): stderr: | 20221214062125417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062125417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062125418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062125418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062125419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062125419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062125419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:26.961153 run osmo-stp_10.42.42.5(pid=16952): stdout: | (launched: 2022-12-14_06:21:25.226443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:27.093209 run osmo-stp_10.42.42.5(pid=16952): stderr: | 20221214062125417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062125417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062125418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062125418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062125419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062125419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062125419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:27.249501 run patchelf(pid=16955): Terminating (SIGINT) 06:21:27.430587 run patchelf(pid=16955): Terminated: ok {rc=0} 06:21:27.560432 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16952): Process ended prematurely: osmo-stp_10.42.42.5(pid=16952) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16952)] [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:21:27.570459 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:21:27.598710 run osmo-hlr_10.42.42.2(pid=16949): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16949)] 06:21:27.648596 run osmo-hlr_10.42.42.2(pid=16949): stdout: | (launched: 2022-12-14_06:21:24.223054) 06:21:27.699966 run osmo-hlr_10.42.42.2(pid=16949): stderr: | 20221214062124419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062124419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062124419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062124419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062124419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062124419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062124431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062124439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062124439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062124439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:27.752014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16948): Terminating (SIGTERM) 06:21:27.793845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16951): Terminating (SIGTERM) 06:21:27.835616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16954): Terminating (SIGTERM) 06:21:27.878239 --- ParallelTerminationStrategy: PID 16948 died... 06:21:27.898545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16948): Terminated: ok {rc=0} 06:21:27.945002 --- ParallelTerminationStrategy: PID 16951 died... 06:21:27.964787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16951): Terminated: ok {rc=0} 06:21:28.010948 --- ParallelTerminationStrategy: PID 16954 died... 06:21:28.030818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16954): Terminated: ok {rc=0} 06:21:28.118495 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:21:29.424757 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:29.432249 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:21:29.466132 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:21:29.502311 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:21:29.556321 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:21:29.590063 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:21:29.625186 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:21:30.184482 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:21:30.190084 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.201955 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:21:30.271079 tst switch_tch_pdch.py: using LAC 39001 06:21:30.398231 tst switch_tch_pdch.py: using RAC 241 06:21:30.522860 tst switch_tch_pdch.py: using CellId 39001 06:21:30.647711 tst switch_tch_pdch.py: using BVCI 39002 06:21:30.765279 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.777063 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.788700 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.800310 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.812046 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.823702 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.839777 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:21:30.853039 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:21:30.990603 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:21:31.125824 tst switch_tch_pdch.py:51: start network... 06:21:31.338187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:31.827530 run create_hlr_db(pid=16959): Launched 06:21:31.982793 bus /gobi_6: Setting Powered False 06:21:33.043280 run create_hlr_db(pid=16959): Terminated: ok {rc=0} 06:21:33.487088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16961): Launched 06:21:33.810020 run osmo-hlr_10.42.42.2(pid=16962): Launched 06:21:33.933038 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:34.493650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16964): Launched 06:21:34.815969 run osmo-stp_10.42.42.5(pid=16965): Launched 06:21:34.939620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:21:35.501757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16967): Launched 06:21:35.623996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:21:35.896609 run patchelf(pid=16968): Launched 06:21:36.074801 run osmo-stp_10.42.42.5(pid=16965): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16965)] 06:21:36.210995 run osmo-stp_10.42.42.5(pid=16965): stdout: | (launched: 2022-12-14_06:21:34.756741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:36.348903 run osmo-stp_10.42.42.5(pid=16965): stderr: | 20221214062134948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062134948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062134948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062134949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062134949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062134949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062134949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:36.487099 run osmo-stp_10.42.42.5(pid=16965): stdout: | (launched: 2022-12-14_06:21:34.756741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:36.618392 run osmo-stp_10.42.42.5(pid=16965): stderr: | 20221214062134948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062134948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062134948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062134949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062134949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062134949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062134949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:36.774141 run patchelf(pid=16968): Terminating (SIGINT) 06:21:36.954007 run patchelf(pid=16968): Terminated: ok {rc=0} 06:21:37.083657 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16965): Process ended prematurely: osmo-stp_10.42.42.5(pid=16965) [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16965)] [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:21:37.093236 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 06:21:37.121306 run osmo-hlr_10.42.42.2(pid=16962): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16962)] 06:21:37.171105 run osmo-hlr_10.42.42.2(pid=16962): stdout: | (launched: 2022-12-14_06:21:33.751071) 06:21:37.222370 run osmo-hlr_10.42.42.2(pid=16962): stderr: | 20221214062133946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062133946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062133946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062133946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062133946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062133946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062133959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062133968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062133969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062133969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:37.274514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16961): Terminating (SIGTERM) 06:21:37.316326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16964): Terminating (SIGTERM) 06:21:37.358674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16967): Terminating (SIGTERM) 06:21:37.401671 --- ParallelTerminationStrategy: PID 16961 died... 06:21:37.421957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16961): Terminated: ok {rc=0} 06:21:37.467965 --- ParallelTerminationStrategy: PID 16964 died... 06:21:37.487516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16964): Terminated: ok {rc=0} 06:21:37.533344 --- ParallelTerminationStrategy: PID 16967 died... 06:21:37.552817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16967): Terminated: ok {rc=0} 06:21:37.639687 bus /gobi_0: Setting Powered False 06:21:38.738249 bus /gobi_0: Setting Powered False 06:21:39.852341 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:21:41.105421 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:41.111686 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:21:41.145267 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:21:41.180599 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:21:41.235134 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:21:41.268538 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:21:41.303370 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:21:41.860153 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:21:41.865775 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:41.877143 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:21:41.949258 tst switch_tch_pdch.py: using LAC 39002 06:21:42.077920 tst switch_tch_pdch.py: using RAC 242 06:21:42.204698 tst switch_tch_pdch.py: using CellId 39002 06:21:42.332454 tst switch_tch_pdch.py: using BVCI 39003 06:21:42.450370 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.461833 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.472798 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.484105 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.495193 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.506522 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.517809 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:21:42.528763 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:21:42.647831 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:21:42.764652 tst switch_tch_pdch.py:51: start network... 06:21:42.967851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:43.410420 run create_hlr_db(pid=16972): Launched 06:21:43.526187 bus /gobi_6: Setting Powered False 06:21:44.586888 run create_hlr_db(pid=16972): Terminated: ok {rc=0} 06:21:45.000779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16974): Launched 06:21:45.323467 run osmo-hlr_10.42.42.2(pid=16975): Launched 06:21:45.447110 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:46.015734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16977): Launched 06:21:46.346161 run osmo-stp_10.42.42.5(pid=16978): Launched 06:21:46.585280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:21:47.205385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16980): Launched 06:21:47.336451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:21:47.593197 run patchelf(pid=16981): Launched 06:21:47.760566 run osmo-stp_10.42.42.5(pid=16978): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16978)] 06:21:47.888398 run osmo-stp_10.42.42.5(pid=16978): stdout: | (launched: 2022-12-14_06:21:46.281725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:48.018344 run osmo-stp_10.42.42.5(pid=16978): stderr: | 20221214062146611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062146611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062146611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062146611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062146612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062146612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062146612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:48.148158 run osmo-stp_10.42.42.5(pid=16978): stdout: | (launched: 2022-12-14_06:21:46.281725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:48.271794 run osmo-stp_10.42.42.5(pid=16978): stderr: | 20221214062146611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062146611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062146611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062146611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062146612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062146612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062146612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:48.418423 run patchelf(pid=16981): Terminating (SIGINT) 06:21:48.588025 run patchelf(pid=16981): Terminated: ok {rc=0} 06:21:48.710591 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16978): Process ended prematurely: osmo-stp_10.42.42.5(pid=16978) [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16978)] [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:21:48.719630 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:21:48.745984 run osmo-hlr_10.42.42.2(pid=16975): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16975)] 06:21:48.793659 run osmo-hlr_10.42.42.2(pid=16975): stdout: | (launched: 2022-12-14_06:21:45.264451) 06:21:48.842660 run osmo-hlr_10.42.42.2(pid=16975): stderr: | 20221214062145458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062145458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062145458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062145458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062145458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062145458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062145470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062145481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062145481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062145481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:48.892057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16974): Terminating (SIGTERM) 06:21:48.931780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16977): Terminating (SIGTERM) 06:21:48.971433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16980): Terminating (SIGTERM) 06:21:49.011342 --- ParallelTerminationStrategy: PID 16974 died... 06:21:49.030909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16974): Terminated: ok {rc=0} 06:21:49.074821 --- ParallelTerminationStrategy: PID 16977 died... 06:21:49.093862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16977): Terminated: ok {rc=0} 06:21:49.137925 --- ParallelTerminationStrategy: PID 16980 died... 06:21:49.157128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16980): Terminated: ok {rc=0} 06:21:49.243195 bus /gobi_0: Setting Powered False 06:21:50.341071 bus /gobi_0: Setting Powered False 06:21:51.453031 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 06:21:52.700754 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:52.704856 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:21:52.733421 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 06:21:52.740137 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:21:52.794867 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:21:52.824578 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 06:21:52.831432 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:21:53.366358 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 06:21:53.371715 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 06:21:53.382794 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:21:53.426639 tst mo_mt_sms.py: using LAC 39003 06:21:53.545565 tst mo_mt_sms.py: using RAC 243 06:21:53.673440 tst mo_mt_sms.py: using CellId 39003 06:21:53.802034 tst mo_mt_sms.py: using BVCI 39004 06:21:53.920084 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:21:54.036060 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:21:54.154279 tst mo_mt_sms.py:9: start nitb and bts... 06:21:54.374495 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:21:55.031238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16985): Launched 06:21:55.352882 run osmo-nitb_10.42.42.2(pid=16986): Launched 06:21:55.533943 run osmo-nitb_10.42.42.2(pid=16986): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16986)] 06:21:55.677395 run osmo-nitb_10.42.42.2(pid=16986): stdout: | (launched: 2022-12-14_06:21:55.293963) 06:21:55.822358 run osmo-nitb_10.42.42.2(pid=16986): stderr: | (launched: 2022-12-14_06:21:55.341985) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:21:55.967384 run osmo-nitb_10.42.42.2(pid=16986): stdout: | (launched: 2022-12-14_06:21:55.293963) 06:21:56.106655 run osmo-nitb_10.42.42.2(pid=16986): stderr: | (launched: 2022-12-14_06:21:55.341985) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16986): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16986) [trial-2400↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16986)] 06:21:56.477245 tst osmo-nitb_10.42.42.2(pid=16986): stdout: | (launched: 2022-12-14_06:21:55.293963) 06:21:56.606764 tst osmo-nitb_10.42.42.2(pid=16986): stderr: | (launched: 2022-12-14_06:21:55.341985) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:21:56.759629 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16986): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16986) [trial-2400↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16986)] [trial-2400↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 06:21:56.769022 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 06:21:56.776256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16985): Terminating (SIGTERM) 06:21:56.986773 --- ParallelTerminationStrategy: PID 16985 died... 06:21:57.008322 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16985): Terminated: ok {rc=0} 06:21:57.095515 bus /sierra_3: Setting Powered False 06:21:58.194327 bus /sierra_3: Setting Powered False 06:21:59.312743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 06:22:00.506016 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:00.510194 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:22:00.538953 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:22:00.566457 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:22:00.618489 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:22:00.647596 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:22:00.674198 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:22:01.232665 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 06:22:01.240002 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:01.256133 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:22:01.313102 tst mo_mt_sms.py: using LAC 39004 06:22:01.474069 tst mo_mt_sms.py: using RAC 244 06:22:01.601259 tst mo_mt_sms.py: using CellId 39004 06:22:01.762518 tst mo_mt_sms.py: using BVCI 39005 06:22:01.886279 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:01.898525 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:01.910732 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:01.922762 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:01.935367 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:01.947804 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:22:02.092523 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:22:02.218314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:02.692586 run create_hlr_db(pid=16990): Launched 06:22:02.809654 bus /sierra_2: Setting Powered False 06:22:03.869814 run create_hlr_db(pid=16990): Terminated: ok {rc=0} 06:22:04.311080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16992): Launched 06:22:04.618650 run osmo-hlr_10.42.42.2(pid=16993): Launched 06:22:04.734617 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:05.256177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16995): Launched 06:22:05.557540 run osmo-stp_10.42.42.5(pid=16996): Launched 06:22:05.672718 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:06.232692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16998): Launched 06:22:06.535590 run osmo-msc_10.42.42.6(pid=16999): Launched 06:22:06.705256 run osmo-stp_10.42.42.5(pid=16996): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16996)] 06:22:06.833471 run osmo-stp_10.42.42.5(pid=16996): stdout: | (launched: 2022-12-14_06:22:05.501881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:06.961552 run osmo-stp_10.42.42.5(pid=16996): stderr: | 20221214062205673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062205673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062205673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062205674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062205674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062205674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062205674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:07.087593 run osmo-stp_10.42.42.5(pid=16996): stdout: | (launched: 2022-12-14_06:22:05.501881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:07.208026 run osmo-stp_10.42.42.5(pid=16996): stderr: | 20221214062205673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062205673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062205673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062205674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062205674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062205674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062205674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:07.351886 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16996): Process ended prematurely: osmo-stp_10.42.42.5(pid=16996) [trial-2400↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16996)] [trial-2400↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 06:22:07.360418 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 06:22:07.386900 run osmo-hlr_10.42.42.2(pid=16993): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16993)] 06:22:07.435498 run osmo-hlr_10.42.42.2(pid=16993): stdout: | (launched: 2022-12-14_06:22:04.562450) 06:22:07.485395 run osmo-hlr_10.42.42.2(pid=16993): stderr: | 20221214062204737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062204737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062204737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062204737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062204737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062204737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062204749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062204758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062204758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062204758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:07.555061 run osmo-msc_10.42.42.6(pid=16999): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16999)] 06:22:07.602928 run osmo-msc_10.42.42.6(pid=16999): stdout: | (launched: 2022-12-14_06:22:06.480190) 06:22:07.653305 run osmo-msc_10.42.42.6(pid=16999): stderr: | 20221214062206749 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062206749 DLGLOBAL DEBUG validating counter group 0x7f76dfc1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062206749 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062206749 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062206749 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062206749 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062206751 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062206751 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062206751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062206752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:07.703672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16992): Terminating (SIGTERM) 06:22:07.744000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16995): Terminating (SIGTERM) 06:22:07.784282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16998): Terminating (SIGTERM) 06:22:07.824752 --- ParallelTerminationStrategy: PID 16992 died... 06:22:07.844408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16992): Terminated: ok {rc=0} 06:22:07.889148 --- ParallelTerminationStrategy: PID 16995 died... 06:22:07.908059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16995): Terminated: ok {rc=0} 06:22:07.952110 --- ParallelTerminationStrategy: PID 16998 died... 06:22:07.971036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16998): Terminated: ok {rc=0} 06:22:08.057452 bus /sierra_3: Setting Powered False 06:22:09.156572 bus /sierra_3: Setting Powered False 06:22:10.271375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 06:22:11.492716 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:11.496651 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:22:11.526335 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 06:22:11.533729 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 06:22:11.569613 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:22:11.599919 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 06:22:11.607056 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 06:22:12.124051 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 06:22:12.129314 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 06:22:12.140111 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:22:12.189843 tst assert_extension.py: using LAC 39005 06:22:12.309401 tst assert_extension.py: using RAC 245 06:22:12.427479 tst assert_extension.py: using CellId 39005 06:22:12.544701 tst assert_extension.py: using BVCI 39006 06:22:12.654594 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 06:22:12.770779 tst assert_extension.py:10: start nitb and bts... 06:22:12.990212 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:22:13.650665 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17004): Launched 06:22:13.974197 run osmo-nitb_10.42.42.2(pid=17005): Launched 06:22:14.152823 run osmo-nitb_10.42.42.2(pid=17005): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17005)] 06:22:14.296915 run osmo-nitb_10.42.42.2(pid=17005): stdout: | (launched: 2022-12-14_06:22:13.915261) 06:22:14.443660 run osmo-nitb_10.42.42.2(pid=17005): stderr: | (launched: 2022-12-14_06:22:13.963086) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:22:14.589412 run osmo-nitb_10.42.42.2(pid=17005): stdout: | (launched: 2022-12-14_06:22:13.915261) 06:22:14.729591 run osmo-nitb_10.42.42.2(pid=17005): stderr: | (launched: 2022-12-14_06:22:13.963086) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17005): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17005) [trial-2400↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17005)] 06:22:15.096539 tst osmo-nitb_10.42.42.2(pid=17005): stdout: | (launched: 2022-12-14_06:22:13.915261) 06:22:15.225945 tst osmo-nitb_10.42.42.2(pid=17005): stderr: | (launched: 2022-12-14_06:22:13.963086) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:22:15.378903 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17005): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17005) [trial-2400↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17005)] [trial-2400↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 06:22:15.387786 tst assert_extension.py:12: Test FAILED (3.3 sec) 06:22:15.395346 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17004): Terminating (SIGTERM) 06:22:15.605405 --- ParallelTerminationStrategy: PID 17004 died... 06:22:15.626709 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17004): Terminated: ok {rc=0} 06:22:15.714333 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 06:22:16.894566 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:16.902453 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:22:16.941754 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:22:16.975644 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 06:22:17.014514 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:22:17.051500 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:22:17.086058 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 06:22:17.597169 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 06:22:17.602461 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:17.613369 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:22:17.657302 tst assert_extension.py: using LAC 39006 06:22:17.776630 tst assert_extension.py: using RAC 246 06:22:17.895517 tst assert_extension.py: using CellId 39006 06:22:18.016467 tst assert_extension.py: using BVCI 39007 06:22:18.126560 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:18.137374 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:18.147968 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:18.158566 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:18.169784 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:22:18.181173 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 06:22:18.301316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:18.802663 run create_hlr_db(pid=17009): Launched 06:22:18.933741 bus /sierra_2: Setting Powered False 06:22:19.997122 run create_hlr_db(pid=17009): Terminated: ok {rc=0} 06:22:20.429237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Launched 06:22:20.731945 run osmo-hlr_10.42.42.2(pid=17012): Launched 06:22:20.847117 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:21.373690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Launched 06:22:21.676805 run osmo-stp_10.42.42.5(pid=17015): Launched 06:22:21.793797 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:22.341121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Launched 06:22:22.643716 run osmo-msc_10.42.42.6(pid=17018): Launched 06:22:22.814250 run osmo-stp_10.42.42.5(pid=17015): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] 06:22:22.941839 run osmo-stp_10.42.42.5(pid=17015): stdout: | (launched: 2022-12-14_06:22:21.620415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:23.069745 run osmo-stp_10.42.42.5(pid=17015): stderr: | 20221214062221790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062221790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062221790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062221791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062221791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062221791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062221791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:23.195196 run osmo-stp_10.42.42.5(pid=17015): stdout: | (launched: 2022-12-14_06:22:21.620415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:23.315531 run osmo-stp_10.42.42.5(pid=17015): stderr: | 20221214062221790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062221790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062221790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062221791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062221791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062221791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062221791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:23.459546 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17015): Process ended prematurely: osmo-stp_10.42.42.5(pid=17015) [trial-2400↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] [trial-2400↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 06:22:23.468047 tst assert_extension.py:17: Test FAILED (5.9 sec) 06:22:23.494240 run osmo-hlr_10.42.42.2(pid=17012): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17012)] 06:22:23.542195 run osmo-hlr_10.42.42.2(pid=17012): stdout: | (launched: 2022-12-14_06:22:20.676038) 06:22:23.591406 run osmo-hlr_10.42.42.2(pid=17012): stderr: | 20221214062220848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062220848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062220848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062220848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062220848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062220848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062220860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062220868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062220869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062220869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:23.660478 run osmo-msc_10.42.42.6(pid=17018): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17018)] 06:22:23.707398 run osmo-msc_10.42.42.6(pid=17018): stdout: | (launched: 2022-12-14_06:22:22.587301) 06:22:23.756773 run osmo-msc_10.42.42.6(pid=17018): stderr: | 20221214062222860 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062222860 DLGLOBAL DEBUG validating counter group 0x7fcdbe216c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062222860 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062222860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062222860 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062222861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062222862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062222863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062222863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062222863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:23.806211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Terminating (SIGTERM) 06:22:23.845986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Terminating (SIGTERM) 06:22:23.885538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Terminating (SIGTERM) 06:22:23.925795 --- ParallelTerminationStrategy: PID 17011 died... 06:22:23.945292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Terminated: ok {rc=0} 06:22:23.989148 --- ParallelTerminationStrategy: PID 17014 died... 06:22:24.008061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Terminated: ok {rc=0} 06:22:24.051772 --- ParallelTerminationStrategy: PID 17017 died... 06:22:24.070608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Terminated: ok {rc=0} 06:22:24.154178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:22:25.365296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:25.372908 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:22:25.403522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:22:25.431498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:22:25.484553 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:22:25.515648 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:22:25.543070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:22:26.095248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:22:26.149164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:26.160872 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:22:26.228302 tst mo_mt_call.py: using LAC 39007 06:22:26.358273 tst mo_mt_call.py: using RAC 247 06:22:26.487040 tst mo_mt_call.py: using CellId 39007 06:22:26.617481 tst mo_mt_call.py: using BVCI 39008 06:22:26.736632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:26.748390 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:26.759969 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:26.771443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:26.783018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:26.794517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:22:26.913063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:22:27.033880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:27.545296 run create_hlr_db(pid=17023): Launched 06:22:27.677905 bus /sierra_2: Setting Powered False 06:22:28.742991 run create_hlr_db(pid=17023): Terminated: ok {rc=0} 06:22:29.182809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Launched 06:22:29.493244 run osmo-hlr_10.42.42.2(pid=17026): Launched 06:22:29.611390 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:30.155333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Launched 06:22:30.464293 run osmo-stp_10.42.42.5(pid=17029): Launched 06:22:30.582700 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:31.208227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Launched 06:22:31.564253 run osmo-msc_10.42.42.6(pid=17032): Launched 06:22:31.803146 run osmo-stp_10.42.42.5(pid=17029): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] 06:22:31.975176 run osmo-stp_10.42.42.5(pid=17029): stdout: | (launched: 2022-12-14_06:22:30.407573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:32.158122 run osmo-stp_10.42.42.5(pid=17029): stderr: | 20221214062230578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062230578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062230578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062230579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062230579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062230579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062230579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:32.370482 run osmo-stp_10.42.42.5(pid=17029): stdout: | (launched: 2022-12-14_06:22:30.407573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:32.513787 run osmo-stp_10.42.42.5(pid=17029): stderr: | 20221214062230578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062230578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062230578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062230579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062230579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062230579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062230579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:32.672293 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17029): Process ended prematurely: osmo-stp_10.42.42.5(pid=17029) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:22:32.682318 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 06:22:32.710453 run osmo-hlr_10.42.42.2(pid=17026): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17026)] 06:22:32.760568 run osmo-hlr_10.42.42.2(pid=17026): stdout: | (launched: 2022-12-14_06:22:29.436042) 06:22:32.812715 run osmo-hlr_10.42.42.2(pid=17026): stderr: | 20221214062229610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062229610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062229610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062229610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062229611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062229611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062229622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062229630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062229630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062229630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:32.884927 run osmo-msc_10.42.42.6(pid=17032): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17032)] 06:22:32.934940 run osmo-msc_10.42.42.6(pid=17032): stdout: | (launched: 2022-12-14_06:22:31.497354) 06:22:32.986608 run osmo-msc_10.42.42.6(pid=17032): stderr: | 20221214062232219 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062232219 DLGLOBAL DEBUG validating counter group 0x7f068dd5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062232219 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062232219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062232219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062232219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062232225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062232228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062232231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062232231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:33.038330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Terminating (SIGTERM) 06:22:33.080229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Terminating (SIGTERM) 06:22:33.122004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Terminating (SIGTERM) 06:22:33.164062 --- ParallelTerminationStrategy: PID 17025 died... 06:22:33.184236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Terminated: ok {rc=0} 06:22:33.230437 --- ParallelTerminationStrategy: PID 17028 died... 06:22:33.250053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Terminated: ok {rc=0} 06:22:33.296139 --- ParallelTerminationStrategy: PID 17031 died... 06:22:33.316118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Terminated: ok {rc=0} 06:22:33.403267 bus /sierra_3: Setting Powered False 06:22:34.502243 bus /sierra_3: Setting Powered False 06:22:35.615963 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:22:36.764490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:36.777290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:22:36.843915 tst mo_mt_call_osmux.py: using LAC 39008 06:22:36.970511 tst mo_mt_call_osmux.py: using RAC 248 06:22:37.097215 tst mo_mt_call_osmux.py: using CellId 39008 06:22:37.223963 tst mo_mt_call_osmux.py: using BVCI 39009 06:22:37.342946 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:37.354866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:37.366486 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:37.378097 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:37.390013 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:22:37.402016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:22:37.519314 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:22:37.640885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:38.150827 run create_hlr_db(pid=17034): Launched 06:22:38.283751 bus /sierra_2: Setting Powered False 06:22:39.349384 run create_hlr_db(pid=17034): Terminated: ok {rc=0} 06:22:39.788726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Launched 06:22:40.097926 run osmo-hlr_10.42.42.2(pid=17037): Launched 06:22:40.215329 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:40.757243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Launched 06:22:41.064797 run osmo-stp_10.42.42.5(pid=17040): Launched 06:22:41.181691 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:41.744105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Launched 06:22:42.053924 run osmo-msc_10.42.42.6(pid=17043): Launched 06:22:42.226784 run osmo-stp_10.42.42.5(pid=17040): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] 06:22:42.357472 run osmo-stp_10.42.42.5(pid=17040): stdout: | (launched: 2022-12-14_06:22:41.008224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:42.487879 run osmo-stp_10.42.42.5(pid=17040): stderr: | 20221214062241176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062241176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062241176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062241177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062241177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062241177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062241177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:42.616331 run osmo-stp_10.42.42.5(pid=17040): stdout: | (launched: 2022-12-14_06:22:41.008224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:42.739213 run osmo-stp_10.42.42.5(pid=17040): stderr: | 20221214062241176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062241176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062241176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062241177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062241177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062241177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062241177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:42.886135 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17040): Process ended prematurely: osmo-stp_10.42.42.5(pid=17040) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:22:42.895268 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:22:42.921985 run osmo-hlr_10.42.42.2(pid=17037): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17037)] 06:22:42.970167 run osmo-hlr_10.42.42.2(pid=17037): stdout: | (launched: 2022-12-14_06:22:40.041462) 06:22:43.019781 run osmo-hlr_10.42.42.2(pid=17037): stderr: | 20221214062240217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062240217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062240217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062240217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062240217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062240217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062240229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062240237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062240238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062240238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:43.089182 run osmo-msc_10.42.42.6(pid=17043): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17043)] 06:22:43.136788 run osmo-msc_10.42.42.6(pid=17043): stdout: | (launched: 2022-12-14_06:22:41.997093) 06:22:43.186507 run osmo-msc_10.42.42.6(pid=17043): stderr: | 20221214062242266 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062242266 DLGLOBAL DEBUG validating counter group 0x7f0613733c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062242266 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062242266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062242266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062242266 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062242268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062242268 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062242269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062242269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:43.236179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Terminating (SIGTERM) 06:22:43.276264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Terminating (SIGTERM) 06:22:43.316348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Terminating (SIGTERM) 06:22:43.356814 --- ParallelTerminationStrategy: PID 17036 died... 06:22:43.376712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Terminated: ok {rc=0} 06:22:43.421284 --- ParallelTerminationStrategy: PID 17039 died... 06:22:43.440469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Terminated: ok {rc=0} 06:22:43.484699 --- ParallelTerminationStrategy: PID 17042 died... 06:22:43.504070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Terminated: ok {rc=0} 06:22:43.591037 bus /sierra_3: Setting Powered False 06:22:44.689361 bus /sierra_3: Setting Powered False 06:22:45.801407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:22:47.088660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:47.096202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:22:47.126682 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:22:47.155298 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:22:47.207507 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:22:47.243071 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:22:47.271063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:22:47.819011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:22:47.872607 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:47.884390 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:22:47.950645 tst mo_mt_call.py: using LAC 39009 06:22:48.078509 tst mo_mt_call.py: using RAC 249 06:22:48.205160 tst mo_mt_call.py: using CellId 39009 06:22:48.332213 tst mo_mt_call.py: using BVCI 39010 06:22:48.453475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:48.465362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:48.476779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:48.488379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:48.500020 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:48.511517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:22:48.630193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:22:48.747546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:49.224581 run create_hlr_db(pid=17048): Launched 06:22:49.342993 bus /sierra_2: Setting Powered False 06:22:50.403607 run create_hlr_db(pid=17048): Terminated: ok {rc=0} 06:22:50.852525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17050): Launched 06:22:51.180887 run osmo-hlr_10.42.42.2(pid=17051): Launched 06:22:51.306213 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:51.874489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17053): Launched 06:22:52.194486 run osmo-stp_10.42.42.5(pid=17054): Launched 06:22:52.312169 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:52.870607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17056): Launched 06:22:53.180007 run osmo-msc_10.42.42.6(pid=17057): Launched 06:22:53.352526 run osmo-stp_10.42.42.5(pid=17054): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17054)] 06:22:53.483173 run osmo-stp_10.42.42.5(pid=17054): stdout: | (launched: 2022-12-14_06:22:52.137834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:53.613398 run osmo-stp_10.42.42.5(pid=17054): stderr: | 20221214062252305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062252305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062252305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062252306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062252306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062252306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062252306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:53.741608 run osmo-stp_10.42.42.5(pid=17054): stdout: | (launched: 2022-12-14_06:22:52.137834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:53.863813 run osmo-stp_10.42.42.5(pid=17054): stderr: | 20221214062252305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062252305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062252305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062252306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062252306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062252306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062252306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:54.010862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17054): Process ended prematurely: osmo-stp_10.42.42.5(pid=17054) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17054)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:22:54.020002 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:22:54.046431 run osmo-hlr_10.42.42.2(pid=17051): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17051)] 06:22:54.094217 run osmo-hlr_10.42.42.2(pid=17051): stdout: | (launched: 2022-12-14_06:22:51.121045) 06:22:54.143383 run osmo-hlr_10.42.42.2(pid=17051): stderr: | 20221214062251316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062251316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062251316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062251316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062251316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062251317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062251328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062251337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062251337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062251337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:54.212366 run osmo-msc_10.42.42.6(pid=17057): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17057)] 06:22:54.259561 run osmo-msc_10.42.42.6(pid=17057): stdout: | (launched: 2022-12-14_06:22:53.123098) 06:22:54.308546 run osmo-msc_10.42.42.6(pid=17057): stderr: | 20221214062253394 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062253394 DLGLOBAL DEBUG validating counter group 0x7f4e6d3c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062253394 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062253394 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062253394 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062253394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062253396 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062253396 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062253397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062253397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:54.357976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17050): Terminating (SIGTERM) 06:22:54.397868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17053): Terminating (SIGTERM) 06:22:54.437953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17056): Terminating (SIGTERM) 06:22:54.478245 --- ParallelTerminationStrategy: PID 17050 died... 06:22:54.497830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17050): Terminated: ok {rc=0} 06:22:54.541924 --- ParallelTerminationStrategy: PID 17053 died... 06:22:54.560674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17053): Terminated: ok {rc=0} 06:22:54.604730 --- ParallelTerminationStrategy: PID 17056 died... 06:22:54.623743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17056): Terminated: ok {rc=0} 06:22:54.709938 bus /sierra_3: Setting Powered False 06:22:55.810264 bus /sierra_3: Setting Powered False 06:22:56.925837 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:22:58.071206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:58.083184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:22:58.148754 tst mo_mt_call_osmux.py: using LAC 39010 06:22:58.273390 tst mo_mt_call_osmux.py: using RAC 250 06:22:58.397226 tst mo_mt_call_osmux.py: using CellId 39010 06:22:58.517197 tst mo_mt_call_osmux.py: using BVCI 39011 06:22:58.628773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:58.640178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:58.651272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:58.662288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:58.674310 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:22:58.685886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:22:58.806686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:22:58.923398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:59.401543 run create_hlr_db(pid=17059): Launched 06:22:59.519323 bus /sierra_2: Setting Powered False 06:23:00.580244 run create_hlr_db(pid=17059): Terminated: ok {rc=0} 06:23:01.050611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17061): Launched 06:23:01.399586 run osmo-hlr_10.42.42.2(pid=17062): Launched 06:23:01.549050 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:02.297703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17064): Launched 06:23:02.629188 run osmo-stp_10.42.42.5(pid=17065): Launched 06:23:02.754506 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:03.350597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17067): Launched 06:23:03.681263 run osmo-msc_10.42.42.6(pid=17068): Launched 06:23:03.863462 run osmo-stp_10.42.42.5(pid=17065): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17065)] 06:23:04.004354 run osmo-stp_10.42.42.5(pid=17065): stdout: | (launched: 2022-12-14_06:23:02.569027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:04.144036 run osmo-stp_10.42.42.5(pid=17065): stderr: | 20221214062302762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062302762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062302762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062302763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062302763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062302763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062302763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:04.280105 run osmo-stp_10.42.42.5(pid=17065): stdout: | (launched: 2022-12-14_06:23:02.569027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:04.410855 run osmo-stp_10.42.42.5(pid=17065): stderr: | 20221214062302762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062302762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062302762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062302763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062302763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062302763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062302763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:04.567090 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17065): Process ended prematurely: osmo-stp_10.42.42.5(pid=17065) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17065)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:23:04.576640 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:23:04.604530 run osmo-hlr_10.42.42.2(pid=17062): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17062)] 06:23:04.654027 run osmo-hlr_10.42.42.2(pid=17062): stdout: | (launched: 2022-12-14_06:23:01.337781) 06:23:04.705601 run osmo-hlr_10.42.42.2(pid=17062): stderr: | 20221214062301689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062301689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062301689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062301689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062301689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062301689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062301702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062301719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062301719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062301719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:04.777557 run osmo-msc_10.42.42.6(pid=17068): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17068)] 06:23:04.827138 run osmo-msc_10.42.42.6(pid=17068): stdout: | (launched: 2022-12-14_06:23:03.620678) 06:23:04.878692 run osmo-msc_10.42.42.6(pid=17068): stderr: | 20221214062303945 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062303945 DLGLOBAL DEBUG validating counter group 0x7f3d10bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062303945 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062303945 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062303946 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062303946 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062303947 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062303948 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062303948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062303948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:04.930352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17061): Terminating (SIGTERM) 06:23:04.971807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17064): Terminating (SIGTERM) 06:23:05.013636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17067): Terminating (SIGTERM) 06:23:05.055496 --- ParallelTerminationStrategy: PID 17061 died... 06:23:05.075538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17061): Terminated: ok {rc=0} 06:23:05.121800 --- ParallelTerminationStrategy: PID 17064 died... 06:23:05.141312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17064): Terminated: ok {rc=0} 06:23:05.187013 --- ParallelTerminationStrategy: PID 17067 died... 06:23:05.206672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17067): Terminated: ok {rc=0} 06:23:05.294022 bus /sierra_3: Setting Powered False 06:23:06.392166 bus /sierra_3: Setting Powered False 06:23:07.505645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:23:08.755429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:08.763052 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:23:08.792894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:23:08.820290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:23:08.872636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:23:08.903103 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:23:08.931228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:23:09.481193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:23:09.531502 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:09.542883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:23:09.608570 tst mo_mt_call.py: using LAC 39011 06:23:09.730105 tst mo_mt_call.py: using RAC 251 06:23:09.851860 tst mo_mt_call.py: using CellId 39011 06:23:09.973361 tst mo_mt_call.py: using BVCI 39012 06:23:10.084339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:10.095898 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:10.107096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:10.118305 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:10.130151 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:10.141820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:23:10.265445 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:23:10.382029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:10.859300 run create_hlr_db(pid=17074): Launched 06:23:10.976328 bus /sierra_2: Setting Powered False 06:23:12.037910 run create_hlr_db(pid=17074): Terminated: ok {rc=0} 06:23:12.488028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17076): Launched 06:23:12.818448 run osmo-hlr_10.42.42.2(pid=17077): Launched 06:23:12.943439 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:13.511850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17079): Launched 06:23:13.840894 run osmo-stp_10.42.42.5(pid=17080): Launched 06:23:13.965370 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:14.564461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17082): Launched 06:23:14.894164 run osmo-msc_10.42.42.6(pid=17083): Launched 06:23:15.076589 run osmo-stp_10.42.42.5(pid=17080): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17080)] 06:23:15.214563 run osmo-stp_10.42.42.5(pid=17080): stdout: | (launched: 2022-12-14_06:23:13.780712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:15.352514 run osmo-stp_10.42.42.5(pid=17080): stderr: | 20221214062313970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062313970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062313970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062313971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062313971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062313971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062313971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:15.489725 run osmo-stp_10.42.42.5(pid=17080): stdout: | (launched: 2022-12-14_06:23:13.780712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:15.620327 run osmo-stp_10.42.42.5(pid=17080): stderr: | 20221214062313970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062313970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062313970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062313971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062313971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062313971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062313971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:15.776722 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17080): Process ended prematurely: osmo-stp_10.42.42.5(pid=17080) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17080)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:23:15.786440 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:23:15.814063 run osmo-hlr_10.42.42.2(pid=17077): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17077)] 06:23:15.864779 run osmo-hlr_10.42.42.2(pid=17077): stdout: | (launched: 2022-12-14_06:23:12.758181) 06:23:15.921708 run osmo-hlr_10.42.42.2(pid=17077): stderr: | 20221214062312955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062312955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062312955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062312955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062312955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062312955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062312967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062312976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062312976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062312976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:15.994818 run osmo-msc_10.42.42.6(pid=17083): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17083)] 06:23:16.045394 run osmo-msc_10.42.42.6(pid=17083): stdout: | (launched: 2022-12-14_06:23:14.833984) 06:23:16.097218 run osmo-msc_10.42.42.6(pid=17083): stderr: | 20221214062315154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062315154 DLGLOBAL DEBUG validating counter group 0x7fdf327dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062315154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062315154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062315154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062315154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062315156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062315157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062315157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062315157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:16.149124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17076): Terminating (SIGTERM) 06:23:16.192843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17079): Terminating (SIGTERM) 06:23:16.236462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17082): Terminating (SIGTERM) 06:23:16.279681 --- ParallelTerminationStrategy: PID 17076 died... 06:23:16.300414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17076): Terminated: ok {rc=0} 06:23:16.349521 --- ParallelTerminationStrategy: PID 17079 died... 06:23:16.369940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17079): Terminated: ok {rc=0} 06:23:16.416797 --- ParallelTerminationStrategy: PID 17082 died... 06:23:16.437738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17082): Terminated: ok {rc=0} 06:23:16.528649 bus /sierra_3: Setting Powered False 06:23:17.626711 bus /sierra_3: Setting Powered False 06:23:18.739143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:23:19.888470 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:19.900874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:23:19.968110 tst mo_mt_call_osmux.py: using LAC 39012 06:23:20.096131 tst mo_mt_call_osmux.py: using RAC 252 06:23:20.224103 tst mo_mt_call_osmux.py: using CellId 39012 06:23:20.352715 tst mo_mt_call_osmux.py: using BVCI 39013 06:23:20.471720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:20.483637 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:20.495212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:20.506863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:20.518524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:23:20.530099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:23:20.647854 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:23:20.769110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:21.279265 run create_hlr_db(pid=17085): Launched 06:23:21.411667 bus /sierra_2: Setting Powered False 06:23:22.476785 run create_hlr_db(pid=17085): Terminated: ok {rc=0} 06:23:22.914123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17087): Launched 06:23:23.222398 run osmo-hlr_10.42.42.2(pid=17088): Launched 06:23:23.338955 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:23.881032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17090): Launched 06:23:24.187929 run osmo-stp_10.42.42.5(pid=17091): Launched 06:23:24.305283 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:24.862478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17093): Launched 06:23:25.170374 run osmo-msc_10.42.42.6(pid=17094): Launched 06:23:25.343010 run osmo-stp_10.42.42.5(pid=17091): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17091)] 06:23:25.474146 run osmo-stp_10.42.42.5(pid=17091): stdout: | (launched: 2022-12-14_06:23:24.131467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:25.603456 run osmo-stp_10.42.42.5(pid=17091): stderr: | 20221214062324300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062324301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062324301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062324301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062324302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062324302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062324302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:25.730779 run osmo-stp_10.42.42.5(pid=17091): stdout: | (launched: 2022-12-14_06:23:24.131467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:25.852550 run osmo-stp_10.42.42.5(pid=17091): stderr: | 20221214062324300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062324301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062324301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062324301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062324302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062324302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062324302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:25.998692 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17091): Process ended prematurely: osmo-stp_10.42.42.5(pid=17091) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17091)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:23:26.007684 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:23:26.033908 run osmo-hlr_10.42.42.2(pid=17088): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17088)] 06:23:26.081914 run osmo-hlr_10.42.42.2(pid=17088): stdout: | (launched: 2022-12-14_06:23:23.165590) 06:23:26.130864 run osmo-hlr_10.42.42.2(pid=17088): stderr: | 20221214062323340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062323340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062323340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062323340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062323340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062323340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062323351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062323359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062323359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062323359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:26.199873 run osmo-msc_10.42.42.6(pid=17094): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17094)] 06:23:26.246866 run osmo-msc_10.42.42.6(pid=17094): stdout: | (launched: 2022-12-14_06:23:25.113510) 06:23:26.296295 run osmo-msc_10.42.42.6(pid=17094): stderr: | 20221214062325382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062325382 DLGLOBAL DEBUG validating counter group 0x7f3e6a89ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062325382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062325382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062325383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062325383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062325385 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062325385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062325385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062325386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:26.345526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17087): Terminating (SIGTERM) 06:23:26.384873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17090): Terminating (SIGTERM) 06:23:26.424459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17093): Terminating (SIGTERM) 06:23:26.464352 --- ParallelTerminationStrategy: PID 17087 died... 06:23:26.483772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17087): Terminated: ok {rc=0} 06:23:26.527644 --- ParallelTerminationStrategy: PID 17090 died... 06:23:26.546616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17090): Terminated: ok {rc=0} 06:23:26.590301 --- ParallelTerminationStrategy: PID 17093 died... 06:23:26.609272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17093): Terminated: ok {rc=0} 06:23:26.692675 bus /sierra_3: Setting Powered False 06:23:27.786373 bus /sierra_3: Setting Powered False 06:23:28.897764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:23:30.145039 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:30.152374 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:23:30.182446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:23:30.209885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:23:30.261635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:23:30.290842 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:23:30.318289 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:23:30.873361 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:23:30.936772 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:30.949591 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:23:31.018280 tst mo_mt_call.py: using LAC 39013 06:23:31.182902 tst mo_mt_call.py: using RAC 253 06:23:31.361189 tst mo_mt_call.py: using CellId 39013 06:23:31.492014 tst mo_mt_call.py: using BVCI 39014 06:23:31.632528 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:31.645181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:31.657939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:31.670480 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:31.683696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:31.696616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:23:31.820936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:23:31.944050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:32.465640 run create_hlr_db(pid=17099): Launched 06:23:32.601196 bus /sierra_2: Setting Powered False 06:23:33.666075 run create_hlr_db(pid=17099): Terminated: ok {rc=0} 06:23:34.121309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17101): Launched 06:23:34.451150 run osmo-hlr_10.42.42.2(pid=17102): Launched 06:23:34.575851 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:35.146434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17104): Launched 06:23:35.475660 run osmo-stp_10.42.42.5(pid=17105): Launched 06:23:35.599834 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:36.192556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17107): Launched 06:23:36.522739 run osmo-msc_10.42.42.6(pid=17108): Launched 06:23:36.705372 run osmo-stp_10.42.42.5(pid=17105): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17105)] 06:23:36.842561 run osmo-stp_10.42.42.5(pid=17105): stdout: | (launched: 2022-12-14_06:23:35.415069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:36.980173 run osmo-stp_10.42.42.5(pid=17105): stderr: | 20221214062335608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062335608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062335609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062335609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062335610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062335610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062335610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:37.117061 run osmo-stp_10.42.42.5(pid=17105): stdout: | (launched: 2022-12-14_06:23:35.415069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:37.247109 run osmo-stp_10.42.42.5(pid=17105): stderr: | 20221214062335608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062335608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062335609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062335609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062335610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062335610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062335610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:37.402864 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17105): Process ended prematurely: osmo-stp_10.42.42.5(pid=17105) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17105)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:23:37.412633 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:23:37.440591 run osmo-hlr_10.42.42.2(pid=17102): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17102)] 06:23:37.489975 run osmo-hlr_10.42.42.2(pid=17102): stdout: | (launched: 2022-12-14_06:23:34.390909) 06:23:37.540938 run osmo-hlr_10.42.42.2(pid=17102): stderr: | 20221214062334589 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062334589 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062334589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062334589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062334589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062334589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062334602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062334610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062334610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062334610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:37.612430 run osmo-msc_10.42.42.6(pid=17108): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17108)] 06:23:37.661688 run osmo-msc_10.42.42.6(pid=17108): stdout: | (launched: 2022-12-14_06:23:36.462520) 06:23:37.712612 run osmo-msc_10.42.42.6(pid=17108): stderr: | 20221214062336785 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062336785 DLGLOBAL DEBUG validating counter group 0x7f10344abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062336785 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062336785 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062336785 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062336785 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062336787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062336788 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062336788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062336788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:37.764422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17101): Terminating (SIGTERM) 06:23:37.806934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17104): Terminating (SIGTERM) 06:23:37.848554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17107): Terminating (SIGTERM) 06:23:37.890186 --- ParallelTerminationStrategy: PID 17101 died... 06:23:37.910255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17101): Terminated: ok {rc=0} 06:23:37.956149 --- ParallelTerminationStrategy: PID 17104 died... 06:23:37.975747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17104): Terminated: ok {rc=0} 06:23:38.021301 --- ParallelTerminationStrategy: PID 17107 died... 06:23:38.040604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17107): Terminated: ok {rc=0} 06:23:38.127290 bus /sierra_3: Setting Powered False 06:23:39.225485 bus /sierra_3: Setting Powered False 06:23:40.340445 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:23:41.490231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:41.502772 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:23:41.570253 tst mo_mt_call_osmux.py: using LAC 39014 06:23:41.700166 tst mo_mt_call_osmux.py: using RAC 254 06:23:41.822649 tst mo_mt_call_osmux.py: using CellId 39014 06:23:41.948354 tst mo_mt_call_osmux.py: using BVCI 39015 06:23:42.061416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:42.072699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:42.084086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:42.095309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:42.106872 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:23:42.118281 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:23:42.239828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:23:42.356752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:42.834168 run create_hlr_db(pid=17110): Launched 06:23:42.952074 bus /sierra_2: Setting Powered False 06:23:44.013465 run create_hlr_db(pid=17110): Terminated: ok {rc=0} 06:23:44.464719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17112): Launched 06:23:44.793412 run osmo-hlr_10.42.42.2(pid=17113): Launched 06:23:44.917289 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:45.489182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17115): Launched 06:23:45.818651 run osmo-stp_10.42.42.5(pid=17116): Launched 06:23:46.012863 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:46.758085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17118): Launched 06:23:47.091136 run osmo-msc_10.42.42.6(pid=17119): Launched 06:23:47.334861 run osmo-stp_10.42.42.5(pid=17116): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17116)] 06:23:47.501519 run osmo-stp_10.42.42.5(pid=17116): stdout: | (launched: 2022-12-14_06:23:45.758188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:47.637439 run osmo-stp_10.42.42.5(pid=17116): stderr: | 20221214062346069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062346069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062346070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062346070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062346070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062346071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062346071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:47.767117 run osmo-stp_10.42.42.5(pid=17116): stdout: | (launched: 2022-12-14_06:23:45.758188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:47.890488 run osmo-stp_10.42.42.5(pid=17116): stderr: | 20221214062346069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062346069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062346070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062346070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062346070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062346071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062346071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:48.037488 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17116): Process ended prematurely: osmo-stp_10.42.42.5(pid=17116) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17116)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:23:48.046635 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 06:23:48.073319 run osmo-hlr_10.42.42.2(pid=17113): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17113)] 06:23:48.121812 run osmo-hlr_10.42.42.2(pid=17113): stdout: | (launched: 2022-12-14_06:23:44.733518) 06:23:48.171458 run osmo-hlr_10.42.42.2(pid=17113): stderr: | 20221214062344930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062344930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062344930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062344930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062344930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062344930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062344943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062344951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062344951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062344952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:48.241355 run osmo-msc_10.42.42.6(pid=17119): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17119)] 06:23:48.288697 run osmo-msc_10.42.42.6(pid=17119): stdout: | (launched: 2022-12-14_06:23:47.031788) 06:23:48.338136 run osmo-msc_10.42.42.6(pid=17119): stderr: | 20221214062347479 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062347479 DLGLOBAL DEBUG validating counter group 0x7f23758a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062347479 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062347479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062347480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062347480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062347481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062347482 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062347482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062347482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:48.387812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17112): Terminating (SIGTERM) 06:23:48.428030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17115): Terminating (SIGTERM) 06:23:48.468210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17118): Terminating (SIGTERM) 06:23:48.508728 --- ParallelTerminationStrategy: PID 17112 died... 06:23:48.528524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17112): Terminated: ok {rc=0} 06:23:48.572798 --- ParallelTerminationStrategy: PID 17115 died... 06:23:48.592634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17115): Terminated: ok {rc=0} 06:23:48.637158 --- ParallelTerminationStrategy: PID 17118 died... 06:23:48.656485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17118): Terminated: ok {rc=0} 06:23:48.743137 bus /sierra_3: Setting Powered False 06:23:49.841313 bus /sierra_3: Setting Powered False 06:23:50.953472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:23:52.203228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:52.210278 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:23:52.239755 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:23:52.266868 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:23:52.322617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:23:52.352776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:23:52.379837 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:23:52.933821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:23:52.987501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:23:52.999408 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:23:53.066176 tst mo_mt_call.py: using LAC 39015 06:23:53.187364 tst mo_mt_call.py: using RAC 255 06:23:53.307271 tst mo_mt_call.py: using CellId 39015 06:23:53.426182 tst mo_mt_call.py: using BVCI 39016 06:23:53.539318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:23:53.550581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:23:53.561649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:23:53.572592 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:23:53.583988 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:23:53.595229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:23:53.716175 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:23:53.835022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:54.312252 run create_hlr_db(pid=17126): Launched 06:23:54.428447 bus /sierra_2: Setting Powered False 06:23:55.489789 run create_hlr_db(pid=17126): Terminated: ok {rc=0} 06:23:55.918241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17128): Launched 06:23:56.225773 run osmo-hlr_10.42.42.2(pid=17129): Launched 06:23:56.343196 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:56.883915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17131): Launched 06:23:57.191644 run osmo-stp_10.42.42.5(pid=17132): Launched 06:23:57.310045 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:57.867239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17134): Launched 06:23:58.175297 run osmo-msc_10.42.42.6(pid=17135): Launched 06:23:58.346681 run osmo-stp_10.42.42.5(pid=17132): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17132)] 06:23:58.476605 run osmo-stp_10.42.42.5(pid=17132): stdout: | (launched: 2022-12-14_06:23:57.134579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:58.606489 run osmo-stp_10.42.42.5(pid=17132): stderr: | 20221214062357302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062357302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062357303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062357303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062357303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062357304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062357304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:58.734028 run osmo-stp_10.42.42.5(pid=17132): stdout: | (launched: 2022-12-14_06:23:57.134579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:58.855643 run osmo-stp_10.42.42.5(pid=17132): stderr: | 20221214062357302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062357302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062357303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062357303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062357303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062357304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062357304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:59.001717 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17132): Process ended prematurely: osmo-stp_10.42.42.5(pid=17132) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17132)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:23:59.010720 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:23:59.036879 run osmo-hlr_10.42.42.2(pid=17129): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17129)] 06:23:59.084222 run osmo-hlr_10.42.42.2(pid=17129): stdout: | (launched: 2022-12-14_06:23:56.168817) 06:23:59.132923 run osmo-hlr_10.42.42.2(pid=17129): stderr: | 20221214062356342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062356342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062356342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062356342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062356342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062356342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062356355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062356363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062356363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062356363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:59.201538 run osmo-msc_10.42.42.6(pid=17135): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17135)] 06:23:59.248197 run osmo-msc_10.42.42.6(pid=17135): stdout: | (launched: 2022-12-14_06:23:58.118304) 06:23:59.296849 run osmo-msc_10.42.42.6(pid=17135): stderr: | 20221214062358389 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062358389 DLGLOBAL DEBUG validating counter group 0x7f09631cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062358389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062358389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062358389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062358389 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062358391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062358391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062358392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062358392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:59.345970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17128): Terminating (SIGTERM) 06:23:59.385393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17131): Terminating (SIGTERM) 06:23:59.424756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17134): Terminating (SIGTERM) 06:23:59.464502 --- ParallelTerminationStrategy: PID 17128 died... 06:23:59.483774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17128): Terminated: ok {rc=0} 06:23:59.527267 --- ParallelTerminationStrategy: PID 17131 died... 06:23:59.546076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17131): Terminated: ok {rc=0} 06:23:59.589428 --- ParallelTerminationStrategy: PID 17134 died... 06:23:59.608132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17134): Terminated: ok {rc=0} 06:23:59.693643 bus /sierra_3: Setting Powered False 06:24:00.791180 bus /sierra_3: Setting Powered False 06:24:01.940835 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:24:03.165686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:24:03.181197 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:24:03.259122 tst mo_mt_call_osmux.py: using LAC 39016 06:24:03.398976 tst mo_mt_call_osmux.py: using RAC 1 06:24:03.559556 tst mo_mt_call_osmux.py: using CellId 39016 06:24:03.691267 tst mo_mt_call_osmux.py: using BVCI 39017 06:24:03.813090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:24:03.825817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:24:03.838412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:24:03.850893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:24:03.863701 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:24:03.876297 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:24:03.997365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:24:04.119128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:04.646462 run create_hlr_db(pid=17406): Launched 06:24:04.817066 bus /sierra_2: Setting Powered False 06:24:05.884370 run create_hlr_db(pid=17406): Terminated: ok {rc=0} 06:24:06.355182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17410): Launched 06:24:06.708596 run osmo-hlr_10.42.42.2(pid=17411): Launched 06:24:06.958915 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:07.650323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17413): Launched 06:24:08.002421 run osmo-stp_10.42.42.5(pid=17414): Launched 06:24:08.252749 run osmo-msc_10.42.42.6: Starting osmo-msc 06:24:08.953286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17416): Launched 06:24:09.305515 run osmo-msc_10.42.42.6(pid=17417): Launched 06:24:09.687843 run osmo-stp_10.42.42.5(pid=17414): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17414)] 06:24:09.993682 run osmo-stp_10.42.42.5(pid=17414): stdout: | (launched: 2022-12-14_06:24:07.941515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:10.141772 run osmo-stp_10.42.42.5(pid=17414): stderr: | 20221214062408231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062408231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062408232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062408232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062408241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062408241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062408241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:10.284555 run osmo-stp_10.42.42.5(pid=17414): stdout: | (launched: 2022-12-14_06:24:07.941515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:10.423547 run osmo-stp_10.42.42.5(pid=17414): stderr: | 20221214062408231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062408231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062408232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062408232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062408241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062408241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062408241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:10.590615 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17414): Process ended prematurely: osmo-stp_10.42.42.5(pid=17414) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17414)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:24:10.602296 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 06:24:10.632059 run osmo-hlr_10.42.42.2(pid=17411): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17411)] 06:24:10.685300 run osmo-hlr_10.42.42.2(pid=17411): stdout: | (launched: 2022-12-14_06:24:06.644941) 06:24:10.739912 run osmo-hlr_10.42.42.2(pid=17411): stderr: | 20221214062406954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062406954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062406954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062406954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062406955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062406955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062406966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062406978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062406978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062406978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:10.815176 run osmo-msc_10.42.42.6(pid=17417): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17417)] 06:24:10.866725 run osmo-msc_10.42.42.6(pid=17417): stdout: | (launched: 2022-12-14_06:24:09.243854) 06:24:10.920902 run osmo-msc_10.42.42.6(pid=17417): stderr: | 20221214062409739 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062409739 DLGLOBAL DEBUG validating counter group 0x7fdd68044c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062409739 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062409739 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062409740 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062409740 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062409750 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062409750 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062409750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062409751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:24:10.975847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17410): Terminating (SIGTERM) 06:24:11.020062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17413): Terminating (SIGTERM) 06:24:11.065887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17416): Terminating (SIGTERM) 06:24:11.111945 --- ParallelTerminationStrategy: PID 17410 died... 06:24:11.134050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17410): Terminated: ok {rc=0} 06:24:11.183331 --- ParallelTerminationStrategy: PID 17413 died... 06:24:11.204861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17413): Terminated: ok {rc=0} 06:24:11.253556 --- ParallelTerminationStrategy: PID 17416 died... 06:24:11.274918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17416): Terminated: ok {rc=0} 06:24:11.367878 bus /sierra_3: Setting Powered False 06:24:12.470957 bus /sierra_3: Setting Powered False 06:24:13.592782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:24:14.856278 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:24:14.864359 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:24:14.895353 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:24:14.923575 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:24:14.982279 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:24:15.013479 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:24:15.041566 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:24:15.589856 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:24:15.644255 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:15.656397 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:24:15.724283 tst mo_mt_call.py: using LAC 39017 06:24:15.857800 tst mo_mt_call.py: using RAC 2 06:24:16.004193 tst mo_mt_call.py: using CellId 39017 06:24:16.148735 tst mo_mt_call.py: using BVCI 39018 06:24:16.320572 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:16.337093 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:16.349528 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:16.361875 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:16.374921 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:16.387947 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:24:16.547851 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:24:16.717372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:17.379352 run create_hlr_db(pid=17422): Launched 06:24:17.558501 bus /sierra_2: Setting Powered False 06:24:18.626949 run create_hlr_db(pid=17422): Terminated: ok {rc=0} 06:24:19.110281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17424): Launched 06:24:19.467245 run osmo-hlr_10.42.42.2(pid=17425): Launched 06:24:19.724707 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:20.411667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17427): Launched 06:24:20.773365 run osmo-stp_10.42.42.5(pid=17428): Launched 06:24:21.031071 run osmo-msc_10.42.42.6: Starting osmo-msc 06:24:21.727860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17430): Launched 06:24:22.085513 run osmo-msc_10.42.42.6(pid=17431): Launched 06:24:22.465681 run osmo-stp_10.42.42.5(pid=17428): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17428)] 06:24:22.767808 run osmo-stp_10.42.42.5(pid=17428): stdout: | (launched: 2022-12-14_06:24:20.707298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:22.927236 run osmo-stp_10.42.42.5(pid=17428): stderr: | 20221214062421005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062421005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062421005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062421006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062421006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062421006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062421006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:23.071606 run osmo-stp_10.42.42.5(pid=17428): stdout: | (launched: 2022-12-14_06:24:20.707298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:23.209677 run osmo-stp_10.42.42.5(pid=17428): stderr: | 20221214062421005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062421005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062421005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062421006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062421006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062421006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062421006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:23.374576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17428): Process ended prematurely: osmo-stp_10.42.42.5(pid=17428) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17428)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:24:23.385698 tst mo_mt_call.py:8: Test FAILED (7.8 sec) 06:24:23.415675 run osmo-hlr_10.42.42.2(pid=17425): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17425)] 06:24:23.468875 run osmo-hlr_10.42.42.2(pid=17425): stdout: | (launched: 2022-12-14_06:24:19.404459) 06:24:23.523951 run osmo-hlr_10.42.42.2(pid=17425): stderr: | 20221214062419710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062419710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062419710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062419710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062419710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062419710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062419730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062419738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062419739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062419739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:23.601134 run osmo-msc_10.42.42.6(pid=17431): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17431)] 06:24:23.653833 run osmo-msc_10.42.42.6(pid=17431): stdout: | (launched: 2022-12-14_06:24:22.023426) 06:24:23.708392 run osmo-msc_10.42.42.6(pid=17431): stderr: | 20221214062422525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062422525 DLGLOBAL DEBUG validating counter group 0x7fa3afff1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062422525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062422525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062422526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062422526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062422527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062422528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062422528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062422528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:24:23.763993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17424): Terminating (SIGTERM) 06:24:23.808091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17427): Terminating (SIGTERM) 06:24:23.856213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17430): Terminating (SIGTERM) 06:24:23.902882 --- ParallelTerminationStrategy: PID 17424 died... 06:24:23.924204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17424): Terminated: ok {rc=0} 06:24:23.975124 --- ParallelTerminationStrategy: PID 17427 died... 06:24:23.996176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17427): Terminated: ok {rc=0} 06:24:24.044410 --- ParallelTerminationStrategy: PID 17430 died... 06:24:24.065779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17430): Terminated: ok {rc=0} 06:24:24.157743 bus /sierra_3: Setting Powered False 06:24:25.256529 bus /sierra_3: Setting Powered False 06:24:26.370089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:24:27.522219 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:27.534956 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:24:27.608638 tst mo_mt_call_osmux.py: using LAC 39018 06:24:27.739799 tst mo_mt_call_osmux.py: using RAC 3 06:24:27.868860 tst mo_mt_call_osmux.py: using CellId 39018 06:24:27.998284 tst mo_mt_call_osmux.py: using BVCI 39019 06:24:28.119294 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:28.131386 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:28.143366 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:28.155229 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:28.167211 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:24:28.179073 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:24:28.297931 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:24:28.420713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:28.939719 run create_hlr_db(pid=17434): Launched 06:24:29.078396 bus /sierra_2: Setting Powered False 06:24:30.144348 run create_hlr_db(pid=17434): Terminated: ok {rc=0} 06:24:30.590435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17436): Launched 06:24:30.921776 run osmo-hlr_10.42.42.2(pid=17437): Launched 06:24:31.124067 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:31.808529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17439): Launched 06:24:32.243871 run osmo-stp_10.42.42.5(pid=17440): Launched 06:24:32.533337 run osmo-msc_10.42.42.6: Starting osmo-msc 06:24:33.178677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17442): Launched 06:24:33.514147 run osmo-msc_10.42.42.6(pid=17443): Launched 06:24:33.700059 run osmo-stp_10.42.42.5(pid=17440): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17440)] 06:24:33.839672 run osmo-stp_10.42.42.5(pid=17440): stdout: | (launched: 2022-12-14_06:24:32.162160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:33.980240 run osmo-stp_10.42.42.5(pid=17440): stderr: | 20221214062432433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062432433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062432434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062432434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062432435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062432435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062432435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:34.119990 run osmo-stp_10.42.42.5(pid=17440): stdout: | (launched: 2022-12-14_06:24:32.162160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:34.252941 run osmo-stp_10.42.42.5(pid=17440): stderr: | 20221214062432433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062432433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062432434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062432434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062432435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062432435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062432435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:34.412177 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17440): Process ended prematurely: osmo-stp_10.42.42.5(pid=17440) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17440)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:24:34.421907 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 06:24:34.449717 run osmo-hlr_10.42.42.2(pid=17437): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17437)] 06:24:34.499585 run osmo-hlr_10.42.42.2(pid=17437): stdout: | (launched: 2022-12-14_06:24:30.850486) 06:24:34.551436 run osmo-hlr_10.42.42.2(pid=17437): stderr: | 20221214062431127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062431127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062431127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062431127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062431127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062431127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062431143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062431170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062431171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062431171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:34.623694 run osmo-msc_10.42.42.6(pid=17443): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17443)] 06:24:34.673431 run osmo-msc_10.42.42.6(pid=17443): stdout: | (launched: 2022-12-14_06:24:33.452071) 06:24:34.725265 run osmo-msc_10.42.42.6(pid=17443): stderr: | 20221214062433778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062433778 DLGLOBAL DEBUG validating counter group 0x7f3e31566c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062433779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062433779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062433779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062433779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062433781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062433781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062433781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062433781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:24:34.777139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17436): Terminating (SIGTERM) 06:24:34.819336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17439): Terminating (SIGTERM) 06:24:34.861380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17442): Terminating (SIGTERM) 06:24:34.903653 --- ParallelTerminationStrategy: PID 17436 died... 06:24:34.923586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17436): Terminated: ok {rc=0} 06:24:34.969391 --- ParallelTerminationStrategy: PID 17439 died... 06:24:34.989077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17439): Terminated: ok {rc=0} 06:24:35.034889 --- ParallelTerminationStrategy: PID 17442 died... 06:24:35.054565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17442): Terminated: ok {rc=0} 06:24:35.142363 bus /sierra_3: Setting Powered False 06:24:36.240724 bus /sierra_3: Setting Powered False 06:24:37.356363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:24:38.612478 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:24:38.618898 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:24:38.649349 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:24:38.676787 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:24:38.729074 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:24:38.759217 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:24:38.786239 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:24:39.339668 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:24:39.390785 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:39.402047 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:24:39.469461 tst mo_mt_call.py: using LAC 39019 06:24:39.591843 tst mo_mt_call.py: using RAC 4 06:24:39.714027 tst mo_mt_call.py: using CellId 39019 06:24:39.836597 tst mo_mt_call.py: using BVCI 39020 06:24:39.950010 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:39.961219 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:39.971987 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:39.982770 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:39.994027 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:40.005269 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:24:40.122578 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:24:40.247926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:40.767451 run create_hlr_db(pid=17448): Launched 06:24:40.903261 bus /sierra_2: Setting Powered False 06:24:41.968938 run create_hlr_db(pid=17448): Terminated: ok {rc=0} 06:24:42.414840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17450): Launched 06:24:42.730167 run osmo-hlr_10.42.42.2(pid=17451): Launched 06:24:42.849390 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:43.404306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17453): Launched 06:24:43.718317 run osmo-stp_10.42.42.5(pid=17454): Launched 06:24:43.839408 run osmo-msc_10.42.42.6: Starting osmo-msc 06:24:44.407293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17456): Launched 06:24:44.723485 run osmo-msc_10.42.42.6(pid=17457): Launched 06:24:44.899796 run osmo-stp_10.42.42.5(pid=17454): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17454)] 06:24:45.032783 run osmo-stp_10.42.42.5(pid=17454): stdout: | (launched: 2022-12-14_06:24:43.660376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:45.165329 run osmo-stp_10.42.42.5(pid=17454): stderr: | 20221214062443831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062443831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062443831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062443832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062443832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062443832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062443832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:45.296365 run osmo-stp_10.42.42.5(pid=17454): stdout: | (launched: 2022-12-14_06:24:43.660376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:45.422027 run osmo-stp_10.42.42.5(pid=17454): stderr: | 20221214062443831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062443831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062443831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062443832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062443832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062443832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062443832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:45.571476 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17454): Process ended prematurely: osmo-stp_10.42.42.5(pid=17454) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17454)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:24:45.580505 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:24:45.607199 run osmo-hlr_10.42.42.2(pid=17451): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17451)] 06:24:45.655585 run osmo-hlr_10.42.42.2(pid=17451): stdout: | (launched: 2022-12-14_06:24:42.671911) 06:24:45.705429 run osmo-hlr_10.42.42.2(pid=17451): stderr: | 20221214062442850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062442851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062442851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062442851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062442851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062442851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062442862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062442870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062442871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062442871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:45.775697 run osmo-msc_10.42.42.6(pid=17457): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17457)] 06:24:45.823798 run osmo-msc_10.42.42.6(pid=17457): stdout: | (launched: 2022-12-14_06:24:44.665064) 06:24:45.905914 run osmo-msc_10.42.42.6(pid=17457): stderr: | 20221214062444936 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062444936 DLGLOBAL DEBUG validating counter group 0x7f56daba6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062444936 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062444936 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062444937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062444937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062444939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062444939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062444940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062444940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:24:45.963860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17450): Terminating (SIGTERM) 06:24:46.005579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17453): Terminating (SIGTERM) 06:24:46.048590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17456): Terminating (SIGTERM) 06:24:46.093185 --- ParallelTerminationStrategy: PID 17450 died... 06:24:46.114284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17450): Terminated: ok {rc=0} 06:24:46.161467 --- ParallelTerminationStrategy: PID 17453 died... 06:24:46.182438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17453): Terminated: ok {rc=0} 06:24:46.229347 --- ParallelTerminationStrategy: PID 17456 died... 06:24:46.250098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17456): Terminated: ok {rc=0} 06:24:46.338849 bus /sierra_3: Setting Powered False 06:24:47.435587 bus /sierra_3: Setting Powered False 06:24:48.552746 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:24:49.702297 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:49.714404 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:24:49.781428 tst mo_mt_call_osmux.py: using LAC 39020 06:24:49.904916 tst mo_mt_call_osmux.py: using RAC 5 06:24:50.029761 tst mo_mt_call_osmux.py: using CellId 39020 06:24:50.154870 tst mo_mt_call_osmux.py: using BVCI 39021 06:24:50.269857 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:50.281195 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:50.292014 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:50.302883 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:50.314298 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:24:50.325711 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:24:50.442740 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:24:50.559842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:51.046691 run create_hlr_db(pid=17459): Launched 06:24:51.168048 bus /sierra_2: Setting Powered False 06:24:52.229710 run create_hlr_db(pid=17459): Terminated: ok {rc=0} 06:24:52.666893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17461): Launched 06:24:52.982431 run osmo-hlr_10.42.42.2(pid=17462): Launched 06:24:53.102471 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:53.656764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17464): Launched 06:24:53.970539 run osmo-stp_10.42.42.5(pid=17465): Launched 06:24:54.090387 run osmo-msc_10.42.42.6: Starting osmo-msc 06:24:54.658158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17467): Launched 06:24:54.974136 run osmo-msc_10.42.42.6(pid=17468): Launched 06:24:55.152335 run osmo-stp_10.42.42.5(pid=17465): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17465)] 06:24:55.285481 run osmo-stp_10.42.42.5(pid=17465): stdout: | (launched: 2022-12-14_06:24:53.912884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:55.418241 run osmo-stp_10.42.42.5(pid=17465): stderr: | 20221214062454084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062454084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062454085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062454085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062454086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062454086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062454086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:55.549170 run osmo-stp_10.42.42.5(pid=17465): stdout: | (launched: 2022-12-14_06:24:53.912884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:55.674160 run osmo-stp_10.42.42.5(pid=17465): stderr: | 20221214062454084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062454084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062454085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062454085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062454086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062454086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062454086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:55.823303 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17465): Process ended prematurely: osmo-stp_10.42.42.5(pid=17465) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17465)] [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:24:55.832463 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:24:55.858883 run osmo-hlr_10.42.42.2(pid=17462): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17462)] 06:24:55.907028 run osmo-hlr_10.42.42.2(pid=17462): stdout: | (launched: 2022-12-14_06:24:52.924040) 06:24:55.956396 run osmo-hlr_10.42.42.2(pid=17462): stderr: | 20221214062453097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062453097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062453098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062453098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062453098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062453098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062453110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062453118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062453118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062453118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:56.025758 run osmo-msc_10.42.42.6(pid=17468): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17468)] 06:24:56.073138 run osmo-msc_10.42.42.6(pid=17468): stdout: | (launched: 2022-12-14_06:24:54.915636) 06:24:56.122450 run osmo-msc_10.42.42.6(pid=17468): stderr: | 20221214062455188 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062455189 DLGLOBAL DEBUG validating counter group 0x7f297f0bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062455189 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062455189 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062455189 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062455189 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062455191 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062455191 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062455191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062455191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:24:56.172075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17461): Terminating (SIGTERM) 06:24:56.212014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17464): Terminating (SIGTERM) 06:24:56.252008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17467): Terminating (SIGTERM) 06:24:56.292562 --- ParallelTerminationStrategy: PID 17461 died... 06:24:56.312256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17461): Terminated: ok {rc=0} 06:24:56.356472 --- ParallelTerminationStrategy: PID 17464 died... 06:24:56.375656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17464): Terminated: ok {rc=0} 06:24:56.420016 --- ParallelTerminationStrategy: PID 17467 died... 06:24:56.439219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17467): Terminated: ok {rc=0} 06:24:56.526085 bus /sierra_3: Setting Powered False 06:24:57.623912 bus /sierra_3: Setting Powered False 06:24:58.736641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 06:24:59.975128 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:24:59.979482 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:25:00.008621 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:25:00.036304 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 06:25:00.121152 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:25:00.150041 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:25:00.176738 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 06:25:00.764028 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 06:25:00.770244 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:00.782296 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:00.835095 tst emergency_mo_mt_call.py: using LAC 39021 06:25:00.986273 tst emergency_mo_mt_call.py: using RAC 6 06:25:01.116435 tst emergency_mo_mt_call.py: using CellId 39021 06:25:01.272210 tst emergency_mo_mt_call.py: using BVCI 39022 06:25:01.405201 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:01.417464 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:01.429256 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:01.441228 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:01.453078 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:01.464766 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:01.589626 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:01.713872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:02.280367 run create_hlr_db(pid=17477): Launched 06:25:02.435667 bus /sierra_2: Setting Powered False 06:25:03.497196 run create_hlr_db(pid=17477): Terminated: ok {rc=0} 06:25:03.957257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17479): Launched 06:25:04.287335 run osmo-hlr_10.42.42.2(pid=17480): Launched 06:25:04.413372 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:04.986013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17482): Launched 06:25:05.315937 run osmo-stp_10.42.42.5(pid=17483): Launched 06:25:05.451393 tst emergency_mo_mt_call.py: using MSISDN 8537 06:25:05.621754 run osmo-msc_10.42.42.6: Starting osmo-msc 06:25:06.216380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17485): Launched 06:25:06.548457 run osmo-msc_10.42.42.6(pid=17486): Launched 06:25:06.732177 run osmo-stp_10.42.42.5(pid=17483): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17483)] 06:25:06.870033 run osmo-stp_10.42.42.5(pid=17483): stdout: | (launched: 2022-12-14_06:25:05.255718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:07.007867 run osmo-stp_10.42.42.5(pid=17483): stderr: | 20221214062505449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062505449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062505449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062505449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062505450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062505450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062505450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:07.145584 run osmo-stp_10.42.42.5(pid=17483): stdout: | (launched: 2022-12-14_06:25:05.255718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:07.276185 run osmo-stp_10.42.42.5(pid=17483): stderr: | 20221214062505449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062505449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062505449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062505449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062505450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062505450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062505450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:07.432596 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17483): Process ended prematurely: osmo-stp_10.42.42.5(pid=17483) [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17483)] [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 06:25:07.441575 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 06:25:07.468885 run osmo-hlr_10.42.42.2(pid=17480): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17480)] 06:25:07.520345 run osmo-hlr_10.42.42.2(pid=17480): stdout: | (launched: 2022-12-14_06:25:04.226988) 06:25:07.572440 run osmo-hlr_10.42.42.2(pid=17480): stderr: | 20221214062504425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062504425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062504425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062504425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062504425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062504425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062504437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062504446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062504446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062504446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:07.644651 run osmo-msc_10.42.42.6(pid=17486): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17486)] 06:25:07.694710 run osmo-msc_10.42.42.6(pid=17486): stdout: | (launched: 2022-12-14_06:25:06.486922) 06:25:07.746186 run osmo-msc_10.42.42.6(pid=17486): stderr: | 20221214062506809 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062506809 DLGLOBAL DEBUG validating counter group 0x7ff4ba7c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062506809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062506809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062506809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062506809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062506811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062506812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062506812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062506812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:25:07.798079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17479): Terminating (SIGTERM) 06:25:07.839584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17482): Terminating (SIGTERM) 06:25:07.881149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17485): Terminating (SIGTERM) 06:25:07.922919 --- ParallelTerminationStrategy: PID 17479 died... 06:25:07.942981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17479): Terminated: ok {rc=0} 06:25:07.988930 --- ParallelTerminationStrategy: PID 17482 died... 06:25:08.008601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17482): Terminated: ok {rc=0} 06:25:08.054564 --- ParallelTerminationStrategy: PID 17485 died... 06:25:08.074304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17485): Terminated: ok {rc=0} 06:25:08.161726 bus /sierra_3: Setting Powered False 06:25:09.259690 bus /sierra_3: Setting Powered False 06:25:10.374812 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 06:25:11.463963 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:11.476086 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:11.523957 tst emergency_preemptive_call.py: using LAC 39022 06:25:11.645965 tst emergency_preemptive_call.py: using RAC 7 06:25:11.766891 tst emergency_preemptive_call.py: using CellId 39022 06:25:11.887096 tst emergency_preemptive_call.py: using BVCI 39023 06:25:12.000654 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:12.011624 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:12.022415 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:12.033065 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:12.044045 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:25:12.055025 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:12.176073 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:12.293061 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:12.412482 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:12.530346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:13.041701 run create_hlr_db(pid=17488): Launched 06:25:13.176364 bus /sierra_2: Setting Powered False 06:25:14.241805 run create_hlr_db(pid=17488): Terminated: ok {rc=0} 06:25:14.681975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17490): Launched 06:25:14.991193 run osmo-hlr_10.42.42.2(pid=17491): Launched 06:25:15.111708 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:15.654184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17493): Launched 06:25:15.998401 run osmo-stp_10.42.42.5(pid=17494): Launched 06:25:16.169331 tst emergency_preemptive_call.py: using MSISDN 8538 06:25:16.605025 run osmo-msc_10.42.42.6: Starting osmo-msc 06:25:17.225265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17496): Launched 06:25:17.543876 run osmo-msc_10.42.42.6(pid=17497): Launched 06:25:17.717932 run osmo-stp_10.42.42.5(pid=17494): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17494)] 06:25:17.849104 run osmo-stp_10.42.42.5(pid=17494): stdout: | (launched: 2022-12-14_06:25:15.937808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:17.978613 run osmo-stp_10.42.42.5(pid=17494): stderr: | 20221214062516314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062516315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062516315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062516317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062516317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062516318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062516318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:18.106838 run osmo-stp_10.42.42.5(pid=17494): stdout: | (launched: 2022-12-14_06:25:15.937808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:18.229134 run osmo-stp_10.42.42.5(pid=17494): stderr: | 20221214062516314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062516315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062516315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062516317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062516317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062516318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062516318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:18.375529 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17494): Process ended prematurely: osmo-stp_10.42.42.5(pid=17494) [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17494)] [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 06:25:18.384092 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 06:25:18.410189 run osmo-hlr_10.42.42.2(pid=17491): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17491)] 06:25:18.458719 run osmo-hlr_10.42.42.2(pid=17491): stdout: | (launched: 2022-12-14_06:25:14.934328) 06:25:18.508231 run osmo-hlr_10.42.42.2(pid=17491): stderr: | 20221214062515108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062515108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062515108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062515108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062515108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062515108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062515119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062515127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062515127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062515127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:18.577775 run osmo-msc_10.42.42.6(pid=17497): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17497)] 06:25:18.625206 run osmo-msc_10.42.42.6(pid=17497): stdout: | (launched: 2022-12-14_06:25:17.487158) 06:25:18.674394 run osmo-msc_10.42.42.6(pid=17497): stderr: | 20221214062517756 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214062517756 DLGLOBAL DEBUG validating counter group 0x7f05ef579c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214062517756 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214062517756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214062517756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214062517756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214062517758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214062517759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214062517759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214062517759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:25:18.724065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17490): Terminating (SIGTERM) 06:25:18.763844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17493): Terminating (SIGTERM) 06:25:18.803608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17496): Terminating (SIGTERM) 06:25:18.843827 --- ParallelTerminationStrategy: PID 17490 died... 06:25:18.863273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17490): Terminated: ok {rc=0} 06:25:18.907631 --- ParallelTerminationStrategy: PID 17493 died... 06:25:18.926646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17493): Terminated: ok {rc=0} 06:25:18.970432 --- ParallelTerminationStrategy: PID 17496 died... 06:25:18.989426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17496): Terminated: ok {rc=0} 06:25:19.074407 bus /sierra_9: Setting Powered False 06:25:20.172646 bus /sierra_9: Setting Powered False 06:25:21.284206 bus /sierra_8: Setting Powered False 06:25:22.381780 bus /sierra_8: Setting Powered False 06:25:23.496635 bus /sierra_3: Setting Powered False 06:25:24.593246 bus /sierra_3: Setting Powered False 06:25:25.708116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 06:25:26.977219 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:25:26.981750 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:25:27.010311 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 06:25:27.049530 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 06:25:27.134894 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:25:27.164819 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 06:25:27.204576 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 06:25:27.800271 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 06:25:27.853604 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:27.864300 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:27.906659 tst cs_paging_gprs_active.py: using LAC 39023 06:25:28.030281 tst cs_paging_gprs_active.py: using RAC 8 06:25:28.152321 tst cs_paging_gprs_active.py: using CellId 39023 06:25:28.272472 tst cs_paging_gprs_active.py: using BVCI 39024 06:25:28.385839 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.396571 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.407241 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.417874 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.428573 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.439489 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.450544 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.461049 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:28.472069 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:28.592638 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:28.712912 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:25:28.924203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:29.239642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17502): Launched 06:25:29.513508 run iperf3-srv_10.42.42.10(pid=17503): Launched 06:25:29.631546 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:25:29.842617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:30.157706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17504): Launched 06:25:30.433127 run iperf3-srv_10.42.42.10(pid=17505): Launched 06:25:30.550968 tst cs_paging_gprs_active.py:38: start network... 06:25:30.762382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:31.257784 run create_hlr_db(pid=17506): Launched 06:25:31.424857 bus /sierra_2: Setting Powered False 06:25:32.487064 run create_hlr_db(pid=17506): Terminated: ok {rc=0} 06:25:32.960800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17508): Launched 06:25:33.301849 run osmo-hlr_10.42.42.2(pid=17509): Launched 06:25:33.435646 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:34.012626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17511): Launched 06:25:34.349438 run osmo-stp_10.42.42.5(pid=17512): Launched 06:25:34.476359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:35.055570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17514): Launched 06:25:35.183589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:35.467742 run patchelf(pid=17515): Launched 06:25:35.655512 run osmo-stp_10.42.42.5(pid=17512): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17512)] 06:25:35.797080 run osmo-stp_10.42.42.5(pid=17512): stdout: | (launched: 2022-12-14_06:25:34.287448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:35.940602 run osmo-stp_10.42.42.5(pid=17512): stderr: | 20221214062534479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062534480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062534480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062534480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062534481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062534481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062534481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:36.084493 run osmo-stp_10.42.42.5(pid=17512): stdout: | (launched: 2022-12-14_06:25:34.287448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:36.221510 run osmo-stp_10.42.42.5(pid=17512): stderr: | 20221214062534479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062534480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062534480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062534480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062534481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062534481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062534481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:36.383893 run patchelf(pid=17515): Terminating (SIGINT) 06:25:36.571734 run patchelf(pid=17515): Terminated: ok {rc=0} 06:25:36.707120 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17512): Process ended prematurely: osmo-stp_10.42.42.5(pid=17512) [trial-2400↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17512)] [trial-2400↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 06:25:36.717589 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:25:36.746222 run osmo-hlr_10.42.42.2(pid=17509): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17509)] 06:25:36.796162 run osmo-hlr_10.42.42.2(pid=17509): stdout: | (launched: 2022-12-14_06:25:33.235945) 06:25:36.847646 run osmo-hlr_10.42.42.2(pid=17509): stderr: | 20221214062533439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062533439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062533439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062533439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062533439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062533439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062533451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062533461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062533462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062533462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:36.899575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17502): Terminating (SIGTERM) 06:25:36.942006 run iperf3-srv_10.42.42.10(pid=17503): Terminating (SIGTERM) 06:25:36.984052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17504): Terminating (SIGTERM) 06:25:37.025941 run iperf3-srv_10.42.42.10(pid=17505): Terminating (SIGTERM) 06:25:37.067726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17508): Terminating (SIGTERM) 06:25:37.110476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17511): Terminating (SIGTERM) 06:25:37.152475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17514): Terminating (SIGTERM) 06:25:37.195286 --- ParallelTerminationStrategy: PID 17502 died... 06:25:37.215527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17502): Terminated: ok {rc=0} 06:25:37.261922 --- ParallelTerminationStrategy: PID 17503 died... 06:25:37.281476 run iperf3-srv_10.42.42.10(pid=17503): Terminated {rc=256} 06:25:37.328290 --- ParallelTerminationStrategy: PID 17504 died... 06:25:37.348139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17504): Terminated: ok {rc=0} 06:25:37.394446 --- ParallelTerminationStrategy: PID 17505 died... 06:25:37.414136 run iperf3-srv_10.42.42.10(pid=17505): Terminated {rc=256} 06:25:37.460223 --- ParallelTerminationStrategy: PID 17508 died... 06:25:37.480032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17508): Terminated: ok {rc=0} 06:25:37.526650 --- ParallelTerminationStrategy: PID 17511 died... 06:25:37.546629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17511): Terminated: ok {rc=0} 06:25:37.593050 --- ParallelTerminationStrategy: PID 17514 died... 06:25:37.612868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17514): Terminated: ok {rc=0} 06:25:37.699211 bus /gobi_0: Setting Powered False 06:25:38.797500 bus /gobi_0: Setting Powered False 06:25:39.912389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 06:25:41.060506 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.072211 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:41.119933 tst iperf3.py: using LAC 39024 06:25:41.243776 tst iperf3.py: using RAC 9 06:25:41.367807 tst iperf3.py: using CellId 39024 06:25:41.491855 tst iperf3.py: using BVCI 39025 06:25:41.607109 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.618138 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.628758 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.639393 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.650260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.661100 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.672596 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.683641 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:41.694810 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:41.815663 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:25:42.042182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:42.379032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Launched 06:25:42.671082 run iperf3-srv_10.42.42.10(pid=17517): Launched 06:25:42.797602 tst iperf3.py:8: start network... 06:25:43.023742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:43.542507 run create_hlr_db(pid=17518): Launched 06:25:43.679110 bus /gobi_6: Setting Powered False 06:25:44.744629 run create_hlr_db(pid=17518): Terminated: ok {rc=0} 06:25:45.191336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17520): Launched 06:25:45.528719 run osmo-hlr_10.42.42.2(pid=17521): Launched 06:25:45.655222 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:46.268725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17523): Launched 06:25:46.640690 run osmo-stp_10.42.42.5(pid=17524): Launched 06:25:46.888546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:47.536811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17526): Launched 06:25:47.664831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:47.948823 run patchelf(pid=17527): Launched 06:25:48.135680 run osmo-stp_10.42.42.5(pid=17524): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17524)] 06:25:48.276640 run osmo-stp_10.42.42.5(pid=17524): stdout: | (launched: 2022-12-14_06:25:46.579478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:48.419507 run osmo-stp_10.42.42.5(pid=17524): stderr: | 20221214062546871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062546871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062546872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062546872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062546873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062546873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062546873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:48.563259 run osmo-stp_10.42.42.5(pid=17524): stdout: | (launched: 2022-12-14_06:25:46.579478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:48.699576 run osmo-stp_10.42.42.5(pid=17524): stderr: | 20221214062546871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062546871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062546872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062546872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062546873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062546873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062546873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:48.861435 run patchelf(pid=17527): Terminating (SIGINT) 06:25:49.048193 run patchelf(pid=17527): Terminated: ok {rc=0} 06:25:49.182912 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17524): Process ended prematurely: osmo-stp_10.42.42.5(pid=17524) [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17524)] [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 06:25:49.193338 tst iperf3.py:8: Test FAILED (8.2 sec) 06:25:49.222151 run osmo-hlr_10.42.42.2(pid=17521): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17521)] 06:25:49.272201 run osmo-hlr_10.42.42.2(pid=17521): stdout: | (launched: 2022-12-14_06:25:45.467020) 06:25:49.324098 run osmo-hlr_10.42.42.2(pid=17521): stderr: | 20221214062545668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062545668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062545668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062545668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062545668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062545668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062545685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062545694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062545695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062545695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:49.376532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Terminating (SIGTERM) 06:25:49.419129 run iperf3-srv_10.42.42.10(pid=17517): Terminating (SIGTERM) 06:25:49.461696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17520): Terminating (SIGTERM) 06:25:49.504181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17523): Terminating (SIGTERM) 06:25:49.546722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17526): Terminating (SIGTERM) 06:25:49.589500 --- ParallelTerminationStrategy: PID 17516 died... 06:25:49.609820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Terminated: ok {rc=0} 06:25:49.656610 --- ParallelTerminationStrategy: PID 17517 died... 06:25:49.676597 run iperf3-srv_10.42.42.10(pid=17517): Terminated {rc=256} 06:25:49.723092 --- ParallelTerminationStrategy: PID 17520 died... 06:25:49.743099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17520): Terminated: ok {rc=0} 06:25:49.789712 --- ParallelTerminationStrategy: PID 17523 died... 06:25:49.809607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17523): Terminated: ok {rc=0} 06:25:49.856143 --- ParallelTerminationStrategy: PID 17526 died... 06:25:49.876020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17526): Terminated: ok {rc=0} 06:25:49.965046 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 06:25:51.116361 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.128733 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:51.176308 tst iperf3m4.py: using LAC 39025 06:25:51.306814 tst iperf3m4.py: using RAC 10 06:25:51.439725 tst iperf3m4.py: using CellId 39025 06:25:51.571005 tst iperf3m4.py: using BVCI 39026 06:25:51.694204 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.705750 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.716727 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.727942 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.739128 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.750290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.761679 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.772676 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:51.783945 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:51.904790 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:52.025918 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:52.147670 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:52.275856 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:25:52.504736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:52.842602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17530): Launched 06:25:53.134746 run iperf3-srv_10.42.42.10(pid=17531): Launched 06:25:53.262272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:25:53.490291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:53.828616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17532): Launched 06:25:54.119569 run iperf3-srv_10.42.42.10(pid=17533): Launched 06:25:54.246169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:25:54.471772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:54.809063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17534): Launched 06:25:55.100576 run iperf3-srv_10.42.42.10(pid=17535): Launched 06:25:55.225965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:25:55.452810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:55.791935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17536): Launched 06:25:56.084765 run iperf3-srv_10.42.42.10(pid=17537): Launched 06:25:56.211503 tst iperf3m4.py:8: start network... 06:25:56.438161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:56.970430 run create_hlr_db(pid=17556): Launched 06:25:57.141063 bus /gobi_6: Setting Powered False 06:25:58.202315 run create_hlr_db(pid=17556): Terminated: ok {rc=0} 06:25:58.662258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17588): Launched 06:25:58.977466 run osmo-hlr_10.42.42.2(pid=17589): Launched 06:25:59.096640 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:59.767745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17591): Launched 06:26:00.077955 run osmo-stp_10.42.42.5(pid=17592): Launched 06:26:00.195223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:00.729814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17594): Launched 06:26:00.853207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:01.167597 run patchelf(pid=17595): Launched 06:26:01.365150 run osmo-stp_10.42.42.5(pid=17592): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17592)] 06:26:01.508286 run osmo-stp_10.42.42.5(pid=17592): stdout: | (launched: 2022-12-14_06:26:00.020888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:01.715823 run osmo-stp_10.42.42.5(pid=17592): stderr: | 20221214062600189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062600189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062600190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062600190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062600190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062600190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062600191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:01.885839 run osmo-stp_10.42.42.5(pid=17592): stdout: | (launched: 2022-12-14_06:26:00.020888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:02.020266 run osmo-stp_10.42.42.5(pid=17592): stderr: | 20221214062600189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062600189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062600190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062600190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062600190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062600190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062600191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:02.178286 run patchelf(pid=17595): Terminating (SIGINT) 06:26:02.355354 run patchelf(pid=17595): Terminated: ok {rc=0} 06:26:02.481502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17592): Process ended prematurely: osmo-stp_10.42.42.5(pid=17592) [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17592)] [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 06:26:02.491211 tst iperf3m4.py:8: Test FAILED (11.4 sec) 06:26:02.518880 run osmo-hlr_10.42.42.2(pid=17589): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17589)] 06:26:02.568325 run osmo-hlr_10.42.42.2(pid=17589): stdout: | (launched: 2022-12-14_06:25:58.919181) 06:26:02.618945 run osmo-hlr_10.42.42.2(pid=17589): stderr: | 20221214062559093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062559093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062559093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062559093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062559093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062559093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062559106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062559114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062559114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062559114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:02.669428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17530): Terminating (SIGTERM) 06:26:02.710173 run iperf3-srv_10.42.42.10(pid=17531): Terminating (SIGTERM) 06:26:02.750583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17532): Terminating (SIGTERM) 06:26:02.791138 run iperf3-srv_10.42.42.10(pid=17533): Terminating (SIGTERM) 06:26:02.831760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17534): Terminating (SIGTERM) 06:26:02.872196 run iperf3-srv_10.42.42.10(pid=17535): Terminating (SIGTERM) 06:26:02.912402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17536): Terminating (SIGTERM) 06:26:02.952865 run iperf3-srv_10.42.42.10(pid=17537): Terminating (SIGTERM) 06:26:02.994679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17588): Terminating (SIGTERM) 06:26:03.035536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17591): Terminating (SIGTERM) 06:26:03.075836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17594): Terminating (SIGTERM) 06:26:03.116688 --- ParallelTerminationStrategy: PID 17530 died... 06:26:03.136274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17530): Terminated: ok {rc=0} 06:26:03.181141 --- ParallelTerminationStrategy: PID 17531 died... 06:26:03.200665 run iperf3-srv_10.42.42.10(pid=17531): Terminated {rc=256} 06:26:03.245232 --- ParallelTerminationStrategy: PID 17532 died... 06:26:03.264630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17532): Terminated: ok {rc=0} 06:26:03.309875 --- ParallelTerminationStrategy: PID 17533 died... 06:26:03.329398 run iperf3-srv_10.42.42.10(pid=17533): Terminated {rc=256} 06:26:03.374014 --- ParallelTerminationStrategy: PID 17534 died... 06:26:03.393537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17534): Terminated: ok {rc=0} 06:26:03.438018 --- ParallelTerminationStrategy: PID 17535 died... 06:26:03.457575 run iperf3-srv_10.42.42.10(pid=17535): Terminated {rc=256} 06:26:03.502298 --- ParallelTerminationStrategy: PID 17536 died... 06:26:03.522135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17536): Terminated: ok {rc=0} 06:26:03.567230 --- ParallelTerminationStrategy: PID 17537 died... 06:26:03.586975 run iperf3-srv_10.42.42.10(pid=17537): Terminated {rc=256} 06:26:03.631710 --- ParallelTerminationStrategy: PID 17588 died... 06:26:03.651521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17588): Terminated: ok {rc=0} 06:26:03.696396 --- ParallelTerminationStrategy: PID 17591 died... 06:26:03.716268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17591): Terminated: ok {rc=0} 06:26:03.761130 --- ParallelTerminationStrategy: PID 17594 died... 06:26:03.780603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17594): Terminated: ok {rc=0} 06:26:03.868047 bus /gobi_4: Setting Powered False 06:26:04.968225 bus /gobi_4: Setting Powered False 06:26:06.080193 bus /gobi_1: Setting Powered False 06:26:07.174636 bus /gobi_1: Setting Powered False 06:26:08.289085 bus /gobi_0: Setting Powered False 06:26:09.387654 bus /gobi_0: Setting Powered False 06:26:10.500011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 06:26:11.599963 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:11.611505 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:26:11.659759 tst ping.py: using LAC 39026 06:26:11.787540 tst ping.py: using RAC 11 06:26:11.913537 tst ping.py: using CellId 39026 06:26:12.035411 tst ping.py: using BVCI 39027 06:26:12.147540 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.158799 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.169713 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.180480 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.191486 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.202661 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.213882 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:12.224872 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:26:12.339793 tst ping.py:19: start network... 06:26:12.544279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:13.015284 run create_hlr_db(pid=17596): Launched 06:26:13.131000 bus /gobi_6: Setting Powered False 06:26:14.191150 run create_hlr_db(pid=17596): Terminated: ok {rc=0} 06:26:14.634801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Launched 06:26:14.959255 run osmo-hlr_10.42.42.2(pid=17599): Launched 06:26:15.084709 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:15.645322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Launched 06:26:15.999669 run osmo-stp_10.42.42.5(pid=17602): Launched 06:26:16.392869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:17.052125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17604): Launched 06:26:17.178388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:17.440473 run patchelf(pid=17605): Launched 06:26:17.610444 run osmo-stp_10.42.42.5(pid=17602): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] 06:26:17.739877 run osmo-stp_10.42.42.5(pid=17602): stdout: | (launched: 2022-12-14_06:26:15.931638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:17.871449 run osmo-stp_10.42.42.5(pid=17602): stderr: | 20221214062616239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062616239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062616241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062616242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062616243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062616243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062616243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:18.002744 run osmo-stp_10.42.42.5(pid=17602): stdout: | (launched: 2022-12-14_06:26:15.931638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:18.127958 run osmo-stp_10.42.42.5(pid=17602): stderr: | 20221214062616239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062616239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062616241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062616242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062616243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062616243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062616243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:18.275790 run patchelf(pid=17605): Terminating (SIGINT) 06:26:18.446621 run patchelf(pid=17605): Terminated: ok {rc=0} 06:26:18.570214 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17602): Process ended prematurely: osmo-stp_10.42.42.5(pid=17602) [trial-2400↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] [trial-2400↪gprs:trx-lms-limenet-micro↪ping.py:22] 06:26:18.579333 tst ping.py:22: Test FAILED (7.0 sec) 06:26:18.605817 run osmo-hlr_10.42.42.2(pid=17599): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17599)] 06:26:18.653846 run osmo-hlr_10.42.42.2(pid=17599): stdout: | (launched: 2022-12-14_06:26:14.900381) 06:26:18.703458 run osmo-hlr_10.42.42.2(pid=17599): stderr: | 20221214062615095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062615095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062615095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062615095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062615095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062615095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062615107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062615116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062615116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062615117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:18.753515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Terminating (SIGTERM) 06:26:18.794146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Terminating (SIGTERM) 06:26:18.834351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17604): Terminating (SIGTERM) 06:26:18.874777 --- ParallelTerminationStrategy: PID 17598 died... 06:26:18.894556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Terminated: ok {rc=0} 06:26:18.938956 --- ParallelTerminationStrategy: PID 17601 died... 06:26:18.957941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Terminated: ok {rc=0} 06:26:19.002190 --- ParallelTerminationStrategy: PID 17604 died... 06:26:19.021312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17604): Terminated: ok {rc=0} 06:26:19.107667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 06:26:20.196302 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.208409 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:26:20.255195 tst ping_idle_ping.py: using LAC 39027 06:26:20.389457 tst ping_idle_ping.py: using RAC 12 06:26:20.517893 tst ping_idle_ping.py: using CellId 39027 06:26:20.644703 tst ping_idle_ping.py: using BVCI 39028 06:26:20.763229 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.774689 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.785949 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.797018 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.807983 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.819192 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.830430 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:26:20.841514 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:26:20.959391 tst ping_idle_ping.py:24: start network... 06:26:21.166311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:21.643572 run create_hlr_db(pid=17606): Launched 06:26:21.761245 bus /gobi_6: Setting Powered False 06:26:22.822552 run create_hlr_db(pid=17606): Terminated: ok {rc=0} 06:26:23.249610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17608): Launched 06:26:23.555492 run osmo-hlr_10.42.42.2(pid=17609): Launched 06:26:23.673286 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:24.209714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17611): Launched 06:26:24.515688 run osmo-stp_10.42.42.5(pid=17612): Launched 06:26:24.633185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:25.161316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17614): Launched 06:26:25.278700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:25.537550 run patchelf(pid=17615): Launched 06:26:25.707313 run osmo-stp_10.42.42.5(pid=17612): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17612)] 06:26:25.836280 run osmo-stp_10.42.42.5(pid=17612): stdout: | (launched: 2022-12-14_06:26:24.459449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:25.966991 run osmo-stp_10.42.42.5(pid=17612): stderr: | 20221214062624629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062624629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062624629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062624630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062624630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062624630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062624630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:26.098084 run osmo-stp_10.42.42.5(pid=17612): stdout: | (launched: 2022-12-14_06:26:24.459449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:26.222549 run osmo-stp_10.42.42.5(pid=17612): stderr: | 20221214062624629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062624629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062624629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062624630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062624630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062624630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062624630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:26.370549 run patchelf(pid=17615): Terminating (SIGINT) 06:26:26.541459 run patchelf(pid=17615): Terminated: ok {rc=0} 06:26:26.664745 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17612): Process ended prematurely: osmo-stp_10.42.42.5(pid=17612) [trial-2400↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17612)] [trial-2400↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 06:26:26.673716 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:26:26.700130 run osmo-hlr_10.42.42.2(pid=17609): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17609)] 06:26:26.748521 run osmo-hlr_10.42.42.2(pid=17609): stdout: | (launched: 2022-12-14_06:26:23.498980) 06:26:26.798153 run osmo-hlr_10.42.42.2(pid=17609): stderr: | 20221214062623672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062623672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062623672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062623672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062623673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062623673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062623685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062623693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062623693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062623693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:26.848249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17608): Terminating (SIGTERM) 06:26:26.888537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17611): Terminating (SIGTERM) 06:26:26.928495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17614): Terminating (SIGTERM) 06:26:26.968697 --- ParallelTerminationStrategy: PID 17608 died... 06:26:26.988027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17608): Terminated: ok {rc=0} 06:26:27.032024 --- ParallelTerminationStrategy: PID 17611 died... 06:26:27.050895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17611): Terminated: ok {rc=0} 06:26:27.094742 --- ParallelTerminationStrategy: PID 17614 died... 06:26:27.113427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17614): Terminated: ok {rc=0} 06:26:27.197579 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 06:26:28.493993 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:26:28.499504 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:26:28.528038 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:26:28.566565 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:26:28.656565 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:26:28.687014 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:26:28.725119 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:26:29.314884 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:26:29.365542 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.376621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:26:29.421407 tst cs_paging_gprs_active.py: using LAC 39028 06:26:29.542977 tst cs_paging_gprs_active.py: using RAC 13 06:26:29.664908 tst cs_paging_gprs_active.py: using CellId 39028 06:26:29.786154 tst cs_paging_gprs_active.py: using BVCI 39029 06:26:29.901440 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.912564 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.923382 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.934190 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.945695 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.957368 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.968904 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.980022 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:29.991190 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:30.113567 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:30.234982 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:26:30.459211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:30.793494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17619): Launched 06:26:31.089535 run iperf3-srv_10.42.42.10(pid=17620): Launched 06:26:31.224327 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:26:31.439976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:31.767352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17621): Launched 06:26:32.072838 run iperf3-srv_10.42.42.10(pid=17622): Launched 06:26:32.211424 tst cs_paging_gprs_active.py:38: start network... 06:26:32.435272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:32.950228 run create_hlr_db(pid=17623): Launched 06:26:33.084049 bus /gobi_6: Setting Powered False 06:26:34.149679 run create_hlr_db(pid=17623): Terminated: ok {rc=0} 06:26:34.594575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17625): Launched 06:26:34.907918 run osmo-hlr_10.42.42.2(pid=17626): Launched 06:26:35.026683 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:35.562380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17628): Launched 06:26:35.874711 run osmo-stp_10.42.42.5(pid=17629): Launched 06:26:35.993402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:36.532490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17631): Launched 06:26:36.651918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:36.916351 run patchelf(pid=17632): Launched 06:26:37.090573 run osmo-stp_10.42.42.5(pid=17629): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17629)] 06:26:37.222992 run osmo-stp_10.42.42.5(pid=17629): stdout: | (launched: 2022-12-14_06:26:35.817613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:37.357120 run osmo-stp_10.42.42.5(pid=17629): stderr: | 20221214062635989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062635990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062635990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062635990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062635991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062635991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062635991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:37.491145 run osmo-stp_10.42.42.5(pid=17629): stdout: | (launched: 2022-12-14_06:26:35.817613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:37.619581 run osmo-stp_10.42.42.5(pid=17629): stderr: | 20221214062635989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062635990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062635990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062635990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062635991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062635991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062635991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:37.771046 run patchelf(pid=17632): Terminating (SIGINT) 06:26:37.946743 run patchelf(pid=17632): Terminated: ok {rc=0} 06:26:38.073489 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17629): Process ended prematurely: osmo-stp_10.42.42.5(pid=17629) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17629)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:26:38.083164 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:26:38.110700 run osmo-hlr_10.42.42.2(pid=17626): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17626)] 06:26:38.158993 run osmo-hlr_10.42.42.2(pid=17626): stdout: | (launched: 2022-12-14_06:26:34.851044) 06:26:38.208713 run osmo-hlr_10.42.42.2(pid=17626): stderr: | 20221214062635025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062635025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062635025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062635025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062635025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062635025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062635038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062635046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062635046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062635046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:38.258970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17619): Terminating (SIGTERM) 06:26:38.299292 run iperf3-srv_10.42.42.10(pid=17620): Terminating (SIGTERM) 06:26:38.339492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17621): Terminating (SIGTERM) 06:26:38.379784 run iperf3-srv_10.42.42.10(pid=17622): Terminating (SIGTERM) 06:26:38.419833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17625): Terminating (SIGTERM) 06:26:38.459993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17628): Terminating (SIGTERM) 06:26:38.499917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17631): Terminating (SIGTERM) 06:26:38.540227 --- ParallelTerminationStrategy: PID 17619 died... 06:26:38.559877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17619): Terminated: ok {rc=0} 06:26:38.604614 --- ParallelTerminationStrategy: PID 17620 died... 06:26:38.623634 run iperf3-srv_10.42.42.10(pid=17620): Terminated {rc=256} 06:26:38.667840 --- ParallelTerminationStrategy: PID 17621 died... 06:26:38.686596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17621): Terminated: ok {rc=0} 06:26:38.730698 --- ParallelTerminationStrategy: PID 17622 died... 06:26:38.749706 run iperf3-srv_10.42.42.10(pid=17622): Terminated {rc=256} 06:26:38.794012 --- ParallelTerminationStrategy: PID 17625 died... 06:26:38.813101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17625): Terminated: ok {rc=0} 06:26:38.857283 --- ParallelTerminationStrategy: PID 17628 died... 06:26:38.877125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17628): Terminated: ok {rc=0} 06:26:38.921786 --- ParallelTerminationStrategy: PID 17631 died... 06:26:38.940885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17631): Terminated: ok {rc=0} 06:26:39.027566 bus /gobi_0: Setting Powered False 06:26:40.127659 bus /gobi_0: Setting Powered False 06:26:41.243098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:26:42.391008 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:42.402794 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:26:42.449526 tst iperf3.py: using LAC 39029 06:26:42.572501 tst iperf3.py: using RAC 14 06:26:42.698549 tst iperf3.py: using CellId 39029 06:26:42.819473 tst iperf3.py: using BVCI 39030 06:26:42.933508 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:42.944479 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:42.955362 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:42.966184 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:42.977233 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:42.988774 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:43.000077 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:43.011111 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:43.022460 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:43.143850 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:26:43.368374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:43.702296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17633): Launched 06:26:43.991471 run iperf3-srv_10.42.42.10(pid=17634): Launched 06:26:44.115243 tst iperf3.py:8: start network... 06:26:44.339000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:44.851722 run create_hlr_db(pid=17635): Launched 06:26:44.987708 bus /gobi_6: Setting Powered False 06:26:46.051649 run create_hlr_db(pid=17635): Terminated: ok {rc=0} 06:26:46.521293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17637): Launched 06:26:46.873731 run osmo-hlr_10.42.42.2(pid=17638): Launched 06:26:47.115655 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:47.692242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17640): Launched 06:26:48.022725 run osmo-stp_10.42.42.5(pid=17641): Launched 06:26:48.153363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:48.689435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17643): Launched 06:26:48.808134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:49.071066 run patchelf(pid=17644): Launched 06:26:49.243578 run osmo-stp_10.42.42.5(pid=17641): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17641)] 06:26:49.374806 run osmo-stp_10.42.42.5(pid=17641): stdout: | (launched: 2022-12-14_06:26:47.962666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:49.507449 run osmo-stp_10.42.42.5(pid=17641): stderr: | 20221214062648153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062648154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062648154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062648154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062648155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062648155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062648155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:49.640322 run osmo-stp_10.42.42.5(pid=17641): stdout: | (launched: 2022-12-14_06:26:47.962666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:49.767140 run osmo-stp_10.42.42.5(pid=17641): stderr: | 20221214062648153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062648154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062648154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062648154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062648155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062648155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062648155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:49.917904 run patchelf(pid=17644): Terminating (SIGINT) 06:26:50.091587 run patchelf(pid=17644): Terminated: ok {rc=0} 06:26:50.216673 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17641): Process ended prematurely: osmo-stp_10.42.42.5(pid=17641) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17641)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 06:26:50.226449 tst iperf3.py:8: Test FAILED (7.9 sec) 06:26:50.253424 run osmo-hlr_10.42.42.2(pid=17638): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17638)] 06:26:50.301371 run osmo-hlr_10.42.42.2(pid=17638): stdout: | (launched: 2022-12-14_06:26:46.806929) 06:26:50.350627 run osmo-hlr_10.42.42.2(pid=17638): stderr: | 20221214062647105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062647105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062647105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062647105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062647105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062647105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062647117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062647125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062647125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062647125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:50.400395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17633): Terminating (SIGTERM) 06:26:50.440496 run iperf3-srv_10.42.42.10(pid=17634): Terminating (SIGTERM) 06:26:50.480316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17637): Terminating (SIGTERM) 06:26:50.520195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17640): Terminating (SIGTERM) 06:26:50.560023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17643): Terminating (SIGTERM) 06:26:50.600056 --- ParallelTerminationStrategy: PID 17633 died... 06:26:50.619421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17633): Terminated: ok {rc=0} 06:26:50.663811 --- ParallelTerminationStrategy: PID 17634 died... 06:26:50.682621 run iperf3-srv_10.42.42.10(pid=17634): Terminated {rc=256} 06:26:50.726275 --- ParallelTerminationStrategy: PID 17637 died... 06:26:50.745138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17637): Terminated: ok {rc=0} 06:26:50.788673 --- ParallelTerminationStrategy: PID 17640 died... 06:26:50.807479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17640): Terminated: ok {rc=0} 06:26:50.851218 --- ParallelTerminationStrategy: PID 17643 died... 06:26:50.870061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17643): Terminated: ok {rc=0} 06:26:50.955922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:26:52.105891 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.120759 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:26:52.166165 tst iperf3m4.py: using LAC 39030 06:26:52.289368 tst iperf3m4.py: using RAC 15 06:26:52.416462 tst iperf3m4.py: using CellId 39030 06:26:52.536520 tst iperf3m4.py: using BVCI 39031 06:26:52.648923 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.660197 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.671073 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.681969 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.693147 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.704275 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.715509 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.726552 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:52.737832 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:52.867149 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:52.986695 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:53.103731 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:53.225607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:26:53.451129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:53.786791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17645): Launched 06:26:54.077398 run iperf3-srv_10.42.42.10(pid=17646): Launched 06:26:54.201608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:26:54.425940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:54.759438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17647): Launched 06:26:55.048513 run iperf3-srv_10.42.42.10(pid=17648): Launched 06:26:55.172349 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:26:55.397302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:55.731753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17649): Launched 06:26:56.021082 run iperf3-srv_10.42.42.10(pid=17650): Launched 06:26:56.144917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:26:56.369555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:56.704250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17651): Launched 06:26:56.993443 run iperf3-srv_10.42.42.10(pid=17652): Launched 06:26:57.117097 tst iperf3m4.py:8: start network... 06:26:57.340803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:57.856129 run create_hlr_db(pid=17653): Launched 06:26:57.990678 bus /gobi_6: Setting Powered False 06:26:59.056633 run create_hlr_db(pid=17653): Terminated: ok {rc=0} 06:26:59.500799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17655): Launched 06:26:59.814495 run osmo-hlr_10.42.42.2(pid=17656): Launched 06:26:59.932865 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:00.482076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17658): Launched 06:27:00.794245 run osmo-stp_10.42.42.5(pid=17659): Launched 06:27:01.046369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:01.679086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17661): Launched 06:27:01.819409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:02.107545 run patchelf(pid=17662): Launched 06:27:02.306065 run osmo-stp_10.42.42.5(pid=17659): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17659)] 06:27:02.446191 run osmo-stp_10.42.42.5(pid=17659): stdout: | (launched: 2022-12-14_06:27:00.736686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:02.590238 run osmo-stp_10.42.42.5(pid=17659): stderr: | 20221214062700962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062700963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062700963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062700963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062700964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062700964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062700964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:02.732158 run osmo-stp_10.42.42.5(pid=17659): stdout: | (launched: 2022-12-14_06:27:00.736686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:02.867546 run osmo-stp_10.42.42.5(pid=17659): stderr: | 20221214062700962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062700963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062700963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062700963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062700964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062700964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062700964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:03.028105 run patchelf(pid=17662): Terminating (SIGINT) 06:27:03.212921 run patchelf(pid=17662): Terminated: ok {rc=0} 06:27:03.346426 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17659): Process ended prematurely: osmo-stp_10.42.42.5(pid=17659) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17659)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 06:27:03.356808 tst iperf3m4.py:8: Test FAILED (11.3 sec) 06:27:03.388774 run osmo-hlr_10.42.42.2(pid=17656): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17656)] 06:27:03.440423 run osmo-hlr_10.42.42.2(pid=17656): stdout: | (launched: 2022-12-14_06:26:59.757104) 06:27:03.493210 run osmo-hlr_10.42.42.2(pid=17656): stderr: | 20221214062659930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062659931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062659931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062659931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062659931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062659931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062659943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062659954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062659955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062659955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:03.546201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17645): Terminating (SIGTERM) 06:27:03.588675 run iperf3-srv_10.42.42.10(pid=17646): Terminating (SIGTERM) 06:27:03.631388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17647): Terminating (SIGTERM) 06:27:03.673780 run iperf3-srv_10.42.42.10(pid=17648): Terminating (SIGTERM) 06:27:03.716435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17649): Terminating (SIGTERM) 06:27:03.758786 run iperf3-srv_10.42.42.10(pid=17650): Terminating (SIGTERM) 06:27:03.800855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17651): Terminating (SIGTERM) 06:27:03.843180 run iperf3-srv_10.42.42.10(pid=17652): Terminating (SIGTERM) 06:27:03.885136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17655): Terminating (SIGTERM) 06:27:03.927401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17658): Terminating (SIGTERM) 06:27:03.969629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17661): Terminating (SIGTERM) 06:27:04.012387 --- ParallelTerminationStrategy: PID 17645 died... 06:27:04.032309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17645): Terminated: ok {rc=0} 06:27:04.079062 --- ParallelTerminationStrategy: PID 17646 died... 06:27:04.098720 run iperf3-srv_10.42.42.10(pid=17646): Terminated {rc=256} 06:27:04.145192 --- ParallelTerminationStrategy: PID 17647 died... 06:27:04.165007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17647): Terminated: ok {rc=0} 06:27:04.211321 --- ParallelTerminationStrategy: PID 17648 died... 06:27:04.231091 run iperf3-srv_10.42.42.10(pid=17648): Terminated {rc=256} 06:27:04.277533 --- ParallelTerminationStrategy: PID 17649 died... 06:27:04.297283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17649): Terminated: ok {rc=0} 06:27:04.343912 --- ParallelTerminationStrategy: PID 17650 died... 06:27:04.363646 run iperf3-srv_10.42.42.10(pid=17650): Terminated {rc=256} 06:27:04.410048 --- ParallelTerminationStrategy: PID 17651 died... 06:27:04.429979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17651): Terminated: ok {rc=0} 06:27:04.476507 --- ParallelTerminationStrategy: PID 17652 died... 06:27:04.496413 run iperf3-srv_10.42.42.10(pid=17652): Terminated {rc=256} 06:27:04.543138 --- ParallelTerminationStrategy: PID 17655 died... 06:27:04.563097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17655): Terminated: ok {rc=0} 06:27:04.609698 --- ParallelTerminationStrategy: PID 17658 died... 06:27:04.629606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17658): Terminated: ok {rc=0} 06:27:04.676156 --- ParallelTerminationStrategy: PID 17661 died... 06:27:04.696017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17661): Terminated: ok {rc=0} 06:27:04.784755 bus /gobi_4: Setting Powered False 06:27:05.884130 bus /gobi_4: Setting Powered False 06:27:07.001152 bus /gobi_1: Setting Powered False 06:27:08.099876 bus /gobi_1: Setting Powered False 06:27:09.217596 bus /gobi_0: Setting Powered False 06:27:10.317211 bus /gobi_0: Setting Powered False 06:27:11.434332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 06:27:12.537952 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:12.550702 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:27:12.598714 tst ping.py: using LAC 39031 06:27:12.728607 tst ping.py: using RAC 16 06:27:12.857383 tst ping.py: using CellId 39031 06:27:12.984841 tst ping.py: using BVCI 39032 06:27:13.098088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.109423 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.120252 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.131398 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.143084 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.154666 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.166518 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:13.178288 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:27:13.298531 tst ping.py:19: start network... 06:27:13.519134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:14.023643 run create_hlr_db(pid=17665): Launched 06:27:14.155236 bus /gobi_6: Setting Powered False 06:27:15.220351 run create_hlr_db(pid=17665): Terminated: ok {rc=0} 06:27:15.657165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17667): Launched 06:27:15.993687 run osmo-hlr_10.42.42.2(pid=17668): Launched 06:27:16.298561 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:16.881105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17670): Launched 06:27:17.208622 run osmo-stp_10.42.42.5(pid=17671): Launched 06:27:17.384769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:17.922175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17673): Launched 06:27:18.049534 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:18.325875 run patchelf(pid=17674): Launched 06:27:18.506712 run osmo-stp_10.42.42.5(pid=17671): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17671)] 06:27:18.645635 run osmo-stp_10.42.42.5(pid=17671): stdout: | (launched: 2022-12-14_06:27:17.148267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:18.785814 run osmo-stp_10.42.42.5(pid=17671): stderr: | 20221214062717390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062717390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062717390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062717391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062717391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062717391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062717391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:18.925795 run osmo-stp_10.42.42.5(pid=17671): stdout: | (launched: 2022-12-14_06:27:17.148267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:19.059648 run osmo-stp_10.42.42.5(pid=17671): stderr: | 20221214062717390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062717390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062717390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062717391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062717391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062717391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062717391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:19.218153 run patchelf(pid=17674): Terminating (SIGINT) 06:27:19.400217 run patchelf(pid=17674): Terminated: ok {rc=0} 06:27:19.531735 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17671): Process ended prematurely: osmo-stp_10.42.42.5(pid=17671) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17671)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 06:27:19.541638 tst ping.py:22: Test FAILED (7.0 sec) 06:27:19.570426 run osmo-hlr_10.42.42.2(pid=17668): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17668)] 06:27:19.621379 run osmo-hlr_10.42.42.2(pid=17668): stdout: | (launched: 2022-12-14_06:27:15.932509) 06:27:19.673900 run osmo-hlr_10.42.42.2(pid=17668): stderr: | 20221214062716165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062716165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062716165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062716165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062716165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062716165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062716180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062716193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062716193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062716193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:19.727120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17667): Terminating (SIGTERM) 06:27:19.769671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17670): Terminating (SIGTERM) 06:27:19.812162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17673): Terminating (SIGTERM) 06:27:19.854889 --- ParallelTerminationStrategy: PID 17667 died... 06:27:19.875343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17667): Terminated: ok {rc=0} 06:27:19.922530 --- ParallelTerminationStrategy: PID 17670 died... 06:27:19.942510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17670): Terminated: ok {rc=0} 06:27:19.989426 --- ParallelTerminationStrategy: PID 17673 died... 06:27:20.009401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17673): Terminated: ok {rc=0} 06:27:20.098501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:27:21.187845 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.199872 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:27:21.246060 tst ping_idle_ping.py: using LAC 39032 06:27:21.368535 tst ping_idle_ping.py: using RAC 17 06:27:21.488823 tst ping_idle_ping.py: using CellId 39032 06:27:21.612811 tst ping_idle_ping.py: using BVCI 39033 06:27:21.725913 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.737336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.748343 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.759395 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.770749 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.782035 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.793592 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:27:21.804785 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:27:21.921089 tst ping_idle_ping.py:24: start network... 06:27:22.127456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:22.604722 run create_hlr_db(pid=17675): Launched 06:27:22.721592 bus /gobi_6: Setting Powered False 06:27:23.782896 run create_hlr_db(pid=17675): Terminated: ok {rc=0} 06:27:24.231375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17677): Launched 06:27:24.558422 run osmo-hlr_10.42.42.2(pid=17678): Launched 06:27:24.683312 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:25.248011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17680): Launched 06:27:25.573455 run osmo-stp_10.42.42.5(pid=17681): Launched 06:27:25.698763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:26.263353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17683): Launched 06:27:26.389261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:26.665883 run patchelf(pid=17684): Launched 06:27:26.847014 run osmo-stp_10.42.42.5(pid=17681): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17681)] 06:27:26.984702 run osmo-stp_10.42.42.5(pid=17681): stdout: | (launched: 2022-12-14_06:27:25.512935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:27.124206 run osmo-stp_10.42.42.5(pid=17681): stderr: | 20221214062725704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062725704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062725704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062725705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062725705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062725705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062725706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:27.263865 run osmo-stp_10.42.42.5(pid=17681): stdout: | (launched: 2022-12-14_06:27:25.512935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:27.397174 run osmo-stp_10.42.42.5(pid=17681): stderr: | 20221214062725704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062725704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062725704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062725705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062725705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062725705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062725706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:27.555621 run patchelf(pid=17684): Terminating (SIGINT) 06:27:27.737627 run patchelf(pid=17684): Terminated: ok {rc=0} 06:27:27.868490 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17681): Process ended prematurely: osmo-stp_10.42.42.5(pid=17681) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17681)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 06:27:27.878370 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:27:27.906208 run osmo-hlr_10.42.42.2(pid=17678): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17678)] 06:27:27.956197 run osmo-hlr_10.42.42.2(pid=17678): stdout: | (launched: 2022-12-14_06:27:24.497792) 06:27:28.007975 run osmo-hlr_10.42.42.2(pid=17678): stderr: | 20221214062724694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062724694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062724694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062724694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062724695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062724695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062724707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062724715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062724716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062724716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:28.060096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17677): Terminating (SIGTERM) 06:27:28.101947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17680): Terminating (SIGTERM) 06:27:28.143839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17683): Terminating (SIGTERM) 06:27:28.186765 --- ParallelTerminationStrategy: PID 17677 died... 06:27:28.206759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17677): Terminated: ok {rc=0} 06:27:28.252806 --- ParallelTerminationStrategy: PID 17680 died... 06:27:28.272446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17680): Terminated: ok {rc=0} 06:27:28.318295 --- ParallelTerminationStrategy: PID 17683 died... 06:27:28.337986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17683): Terminated: ok {rc=0} 06:27:28.426313 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:27:29.735703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:27:29.742474 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:27:29.772258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:27:29.811943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:27:29.903664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:27:29.933790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:27:29.972913 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:27:30.569436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:27:30.622778 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:30.634412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:27:30.700835 tst cs_paging_gprs_active.py: using LAC 39033 06:27:30.829253 tst cs_paging_gprs_active.py: using RAC 18 06:27:30.968578 tst cs_paging_gprs_active.py: using CellId 39033 06:27:31.101204 tst cs_paging_gprs_active.py: using BVCI 39034 06:27:31.219467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.231864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.244172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.256312 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.269574 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.282650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.295909 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.308699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:31.322010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:31.448129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:31.594419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:27:31.886810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:32.270095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17688): Launched 06:27:32.570664 run iperf3-srv_10.42.42.10(pid=17689): Launched 06:27:32.696450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:27:32.921063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:33.255773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17690): Launched 06:27:33.545798 run iperf3-srv_10.42.42.10(pid=17691): Launched 06:27:33.670915 tst cs_paging_gprs_active.py:38: start network... 06:27:33.894885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:34.410550 run create_hlr_db(pid=17692): Launched 06:27:34.546934 bus /gobi_6: Setting Powered False 06:27:35.612150 run create_hlr_db(pid=17692): Terminated: ok {rc=0} 06:27:36.057545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17694): Launched 06:27:36.371511 run osmo-hlr_10.42.42.2(pid=17695): Launched 06:27:36.491096 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:37.045992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17697): Launched 06:27:37.360064 run osmo-stp_10.42.42.5(pid=17698): Launched 06:27:37.479814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:38.019888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17700): Launched 06:27:38.139650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:38.404626 run patchelf(pid=17701): Launched 06:27:38.580586 run osmo-stp_10.42.42.5(pid=17698): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17698)] 06:27:38.713047 run osmo-stp_10.42.42.5(pid=17698): stdout: | (launched: 2022-12-14_06:27:37.302596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:38.847385 run osmo-stp_10.42.42.5(pid=17698): stderr: | 20221214062737471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062737471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062737471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062737472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062737472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062737472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062737473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:38.981550 run osmo-stp_10.42.42.5(pid=17698): stdout: | (launched: 2022-12-14_06:27:37.302596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:39.109397 run osmo-stp_10.42.42.5(pid=17698): stderr: | 20221214062737471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062737471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062737471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062737472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062737472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062737472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062737473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:39.260590 run patchelf(pid=17701): Terminating (SIGINT) 06:27:39.436427 run patchelf(pid=17701): Terminated: ok {rc=0} 06:27:39.563240 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17698): Process ended prematurely: osmo-stp_10.42.42.5(pid=17698) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17698)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:27:39.573071 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 06:27:39.600086 run osmo-hlr_10.42.42.2(pid=17695): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17695)] 06:27:39.648353 run osmo-hlr_10.42.42.2(pid=17695): stdout: | (launched: 2022-12-14_06:27:36.313757) 06:27:39.697843 run osmo-hlr_10.42.42.2(pid=17695): stderr: | 20221214062736489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062736489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062736489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062736489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062736489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062736489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062736504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062736512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062736513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062736513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:39.747755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17688): Terminating (SIGTERM) 06:27:39.787901 run iperf3-srv_10.42.42.10(pid=17689): Terminating (SIGTERM) 06:27:39.827804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17690): Terminating (SIGTERM) 06:27:39.867872 run iperf3-srv_10.42.42.10(pid=17691): Terminating (SIGTERM) 06:27:39.907582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17694): Terminating (SIGTERM) 06:27:39.948584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17697): Terminating (SIGTERM) 06:27:39.992670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17700): Terminating (SIGTERM) 06:27:40.034935 --- ParallelTerminationStrategy: PID 17688 died... 06:27:40.055469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17688): Terminated: ok {rc=0} 06:27:40.101944 --- ParallelTerminationStrategy: PID 17689 died... 06:27:40.122190 run iperf3-srv_10.42.42.10(pid=17689): Terminated {rc=256} 06:27:40.168822 --- ParallelTerminationStrategy: PID 17690 died... 06:27:40.189551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17690): Terminated: ok {rc=0} 06:27:40.236413 --- ParallelTerminationStrategy: PID 17691 died... 06:27:40.256694 run iperf3-srv_10.42.42.10(pid=17691): Terminated {rc=256} 06:27:40.303773 --- ParallelTerminationStrategy: PID 17694 died... 06:27:40.324101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17694): Terminated: ok {rc=0} 06:27:40.370944 --- ParallelTerminationStrategy: PID 17697 died... 06:27:40.391401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17697): Terminated: ok {rc=0} 06:27:40.438206 --- ParallelTerminationStrategy: PID 17700 died... 06:27:40.458479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17700): Terminated: ok {rc=0} 06:27:40.546606 bus /gobi_0: Setting Powered False 06:27:41.646295 bus /gobi_0: Setting Powered False 06:27:42.761765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:27:43.911295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:43.923751 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:27:43.994233 tst iperf3.py: using LAC 39034 06:27:44.124939 tst iperf3.py: using RAC 19 06:27:44.255769 tst iperf3.py: using CellId 39034 06:27:44.385591 tst iperf3.py: using BVCI 39035 06:27:44.501846 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.513211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.524332 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.535286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.546729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.558297 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.570613 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.581983 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:44.593435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:44.715017 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:27:44.939157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:45.272882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17702): Launched 06:27:45.562416 run iperf3-srv_10.42.42.10(pid=17703): Launched 06:27:45.686624 tst iperf3.py:8: start network... 06:27:45.916016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:46.422325 run create_hlr_db(pid=17704): Launched 06:27:46.580614 bus /gobi_6: Setting Powered False 06:27:47.642636 run create_hlr_db(pid=17704): Terminated: ok {rc=0} 06:27:48.097886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17706): Launched 06:27:48.429690 run osmo-hlr_10.42.42.2(pid=17707): Launched 06:27:48.556648 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:49.138044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17709): Launched 06:27:49.468629 run osmo-stp_10.42.42.5(pid=17710): Launched 06:27:49.595296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:50.168224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17712): Launched 06:27:50.295315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:50.577362 run patchelf(pid=17713): Launched 06:27:50.761357 run osmo-stp_10.42.42.5(pid=17710): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17710)] 06:27:50.901824 run osmo-stp_10.42.42.5(pid=17710): stdout: | (launched: 2022-12-14_06:27:49.408133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:51.044117 run osmo-stp_10.42.42.5(pid=17710): stderr: | 20221214062749601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062749602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062749602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062749602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062749603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062749603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062749603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:51.186360 run osmo-stp_10.42.42.5(pid=17710): stdout: | (launched: 2022-12-14_06:27:49.408133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:51.321897 run osmo-stp_10.42.42.5(pid=17710): stderr: | 20221214062749601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062749602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062749602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062749602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062749603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062749603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062749603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:51.482548 run patchelf(pid=17713): Terminating (SIGINT) 06:27:51.668867 run patchelf(pid=17713): Terminated: ok {rc=0} 06:27:51.802885 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17710): Process ended prematurely: osmo-stp_10.42.42.5(pid=17710) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17710)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 06:27:51.813284 tst iperf3.py:8: Test FAILED (7.9 sec) 06:27:51.841788 run osmo-hlr_10.42.42.2(pid=17707): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17707)] 06:27:51.892038 run osmo-hlr_10.42.42.2(pid=17707): stdout: | (launched: 2022-12-14_06:27:48.369304) 06:27:51.943802 run osmo-hlr_10.42.42.2(pid=17707): stderr: | 20221214062748568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062748568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062748568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062748568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062748568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062748568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062748580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062748591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062748591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062748591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:51.996276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17702): Terminating (SIGTERM) 06:27:52.038487 run iperf3-srv_10.42.42.10(pid=17703): Terminating (SIGTERM) 06:27:52.080442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17706): Terminating (SIGTERM) 06:27:52.122435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17709): Terminating (SIGTERM) 06:27:52.164455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17712): Terminating (SIGTERM) 06:27:52.206754 --- ParallelTerminationStrategy: PID 17702 died... 06:27:52.226771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17702): Terminated: ok {rc=0} 06:27:52.273076 --- ParallelTerminationStrategy: PID 17703 died... 06:27:52.292687 run iperf3-srv_10.42.42.10(pid=17703): Terminated {rc=256} 06:27:52.339009 --- ParallelTerminationStrategy: PID 17706 died... 06:27:52.358692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17706): Terminated: ok {rc=0} 06:27:52.405218 --- ParallelTerminationStrategy: PID 17709 died... 06:27:52.424643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17709): Terminated: ok {rc=0} 06:27:52.470781 --- ParallelTerminationStrategy: PID 17712 died... 06:27:52.490426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17712): Terminated: ok {rc=0} 06:27:52.577520 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:27:53.729381 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:53.741622 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:27:53.808605 tst iperf3m4.py: using LAC 39035 06:27:53.937748 tst iperf3m4.py: using RAC 20 06:27:54.068086 tst iperf3m4.py: using CellId 39035 06:27:54.198766 tst iperf3m4.py: using BVCI 39036 06:27:54.318614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.330287 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.341823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.353311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.364680 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.376069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.387757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.399318 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:54.411039 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:54.532078 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:54.655542 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:54.772720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:54.890740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:27:55.101120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:55.415588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17714): Launched 06:27:55.689124 run iperf3-srv_10.42.42.10(pid=17715): Launched 06:27:55.806461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:27:56.016747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:56.350477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17716): Launched 06:27:56.639740 run iperf3-srv_10.42.42.10(pid=17717): Launched 06:27:56.763794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:27:56.988214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:57.323075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17718): Launched 06:27:57.613980 run iperf3-srv_10.42.42.10(pid=17719): Launched 06:27:57.738371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:27:57.963141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:58.298045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17720): Launched 06:27:58.588135 run iperf3-srv_10.42.42.10(pid=17721): Launched 06:27:58.712327 tst iperf3m4.py:8: start network... 06:27:58.937125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:59.452929 run create_hlr_db(pid=17722): Launched 06:27:59.587461 bus /gobi_6: Setting Powered False 06:28:00.652922 run create_hlr_db(pid=17722): Terminated: ok {rc=0} 06:28:01.149765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17724): Launched 06:28:01.487992 run osmo-hlr_10.42.42.2(pid=17725): Launched 06:28:01.739725 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:02.406502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17727): Launched 06:28:02.740681 run osmo-stp_10.42.42.5(pid=17728): Launched 06:28:02.867315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:03.442823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17730): Launched 06:28:03.570665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:03.852705 run patchelf(pid=17731): Launched 06:28:04.038997 run osmo-stp_10.42.42.5(pid=17728): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17728)] 06:28:04.180327 run osmo-stp_10.42.42.5(pid=17728): stdout: | (launched: 2022-12-14_06:28:02.679442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:04.322529 run osmo-stp_10.42.42.5(pid=17728): stderr: | 20221214062802872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062802872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062802872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062802873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062802873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062802873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062802873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:04.465788 run osmo-stp_10.42.42.5(pid=17728): stdout: | (launched: 2022-12-14_06:28:02.679442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:04.602691 run osmo-stp_10.42.42.5(pid=17728): stderr: | 20221214062802872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062802872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062802872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062802873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062802873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062802873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062802873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:04.764083 run patchelf(pid=17731): Terminating (SIGINT) 06:28:04.950243 run patchelf(pid=17731): Terminated: ok {rc=0} 06:28:05.084897 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17728): Process ended prematurely: osmo-stp_10.42.42.5(pid=17728) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17728)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:28:05.095405 tst iperf3m4.py:8: Test FAILED (11.4 sec) 06:28:05.124325 run osmo-hlr_10.42.42.2(pid=17725): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17725)] 06:28:05.174690 run osmo-hlr_10.42.42.2(pid=17725): stdout: | (launched: 2022-12-14_06:28:01.426877) 06:28:05.227479 run osmo-hlr_10.42.42.2(pid=17725): stderr: | 20221214062801733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062801733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062801733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062801733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062801733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062801733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062801746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062801759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062801759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062801759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:05.280149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17714): Terminating (SIGTERM) 06:28:05.322512 run iperf3-srv_10.42.42.10(pid=17715): Terminating (SIGTERM) 06:28:05.364663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17716): Terminating (SIGTERM) 06:28:05.407089 run iperf3-srv_10.42.42.10(pid=17717): Terminating (SIGTERM) 06:28:05.449221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17718): Terminating (SIGTERM) 06:28:05.491491 run iperf3-srv_10.42.42.10(pid=17719): Terminating (SIGTERM) 06:28:05.533672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17720): Terminating (SIGTERM) 06:28:05.576297 run iperf3-srv_10.42.42.10(pid=17721): Terminating (SIGTERM) 06:28:05.618621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17724): Terminating (SIGTERM) 06:28:05.660998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17727): Terminating (SIGTERM) 06:28:05.703180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17730): Terminating (SIGTERM) 06:28:05.745683 --- ParallelTerminationStrategy: PID 17714 died... 06:28:05.766019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17714): Terminated: ok {rc=0} 06:28:05.812842 --- ParallelTerminationStrategy: PID 17715 died... 06:28:05.832629 run iperf3-srv_10.42.42.10(pid=17715): Terminated {rc=256} 06:28:05.879076 --- ParallelTerminationStrategy: PID 17716 died... 06:28:05.898783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17716): Terminated: ok {rc=0} 06:28:05.945178 --- ParallelTerminationStrategy: PID 17717 died... 06:28:05.964731 run iperf3-srv_10.42.42.10(pid=17717): Terminated {rc=256} 06:28:06.010997 --- ParallelTerminationStrategy: PID 17718 died... 06:28:06.030785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17718): Terminated: ok {rc=0} 06:28:06.077203 --- ParallelTerminationStrategy: PID 17719 died... 06:28:06.096772 run iperf3-srv_10.42.42.10(pid=17719): Terminated {rc=256} 06:28:06.143097 --- ParallelTerminationStrategy: PID 17720 died... 06:28:06.162819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17720): Terminated: ok {rc=0} 06:28:06.209340 --- ParallelTerminationStrategy: PID 17721 died... 06:28:06.229039 run iperf3-srv_10.42.42.10(pid=17721): Terminated {rc=256} 06:28:06.275261 --- ParallelTerminationStrategy: PID 17724 died... 06:28:06.294940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17724): Terminated: ok {rc=0} 06:28:06.341352 --- ParallelTerminationStrategy: PID 17727 died... 06:28:06.361174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17727): Terminated: ok {rc=0} 06:28:06.407693 --- ParallelTerminationStrategy: PID 17730 died... 06:28:06.427455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17730): Terminated: ok {rc=0} 06:28:06.516105 bus /gobi_4: Setting Powered False 06:28:07.615476 bus /gobi_4: Setting Powered False 06:28:08.732013 bus /gobi_1: Setting Powered False 06:28:09.830600 bus /gobi_1: Setting Powered False 06:28:10.950791 bus /gobi_0: Setting Powered False 06:28:12.049969 bus /gobi_0: Setting Powered False 06:28:13.165420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:28:14.269600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.282173 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:28:14.349411 tst ping.py: using LAC 39036 06:28:14.471234 tst ping.py: using RAC 21 06:28:14.592459 tst ping.py: using CellId 39036 06:28:14.711419 tst ping.py: using BVCI 39037 06:28:14.824451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.835781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.846741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.858215 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.869420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.880513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.891861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:14.903057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:28:15.021643 tst ping.py:19: start network... 06:28:15.243489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:15.748751 run create_hlr_db(pid=17732): Launched 06:28:15.881993 bus /gobi_6: Setting Powered False 06:28:16.945119 run create_hlr_db(pid=17732): Terminated: ok {rc=0} 06:28:17.406122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17734): Launched 06:28:17.730685 run osmo-hlr_10.42.42.2(pid=17735): Launched 06:28:17.857928 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:18.425843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17737): Launched 06:28:18.753806 run osmo-stp_10.42.42.5(pid=17738): Launched 06:28:18.877622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:19.442544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17740): Launched 06:28:19.567025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:19.843022 run patchelf(pid=17741): Launched 06:28:20.024925 run osmo-stp_10.42.42.5(pid=17738): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17738)] 06:28:20.162628 run osmo-stp_10.42.42.5(pid=17738): stdout: | (launched: 2022-12-14_06:28:18.694339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:20.302117 run osmo-stp_10.42.42.5(pid=17738): stderr: | 20221214062818886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062818887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062818887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062818887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062818888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062818888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062818888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:20.441470 run osmo-stp_10.42.42.5(pid=17738): stdout: | (launched: 2022-12-14_06:28:18.694339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:20.574958 run osmo-stp_10.42.42.5(pid=17738): stderr: | 20221214062818886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062818887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062818887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062818887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062818888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062818888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062818888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:20.733533 run patchelf(pid=17741): Terminating (SIGINT) 06:28:20.915117 run patchelf(pid=17741): Terminated: ok {rc=0} 06:28:21.046046 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17738): Process ended prematurely: osmo-stp_10.42.42.5(pid=17738) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17738)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 06:28:21.055877 tst ping.py:22: Test FAILED (6.8 sec) 06:28:21.083931 run osmo-hlr_10.42.42.2(pid=17735): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17735)] 06:28:21.133912 run osmo-hlr_10.42.42.2(pid=17735): stdout: | (launched: 2022-12-14_06:28:17.671025) 06:28:21.185849 run osmo-hlr_10.42.42.2(pid=17735): stderr: | 20221214062817868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062817868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062817868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062817868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062817868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062817868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062817881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062817890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062817890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062817890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:21.238361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17734): Terminating (SIGTERM) 06:28:21.280130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17737): Terminating (SIGTERM) 06:28:21.322153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17740): Terminating (SIGTERM) 06:28:21.364338 --- ParallelTerminationStrategy: PID 17734 died... 06:28:21.384631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17734): Terminated: ok {rc=0} 06:28:21.431546 --- ParallelTerminationStrategy: PID 17737 died... 06:28:21.451304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17737): Terminated: ok {rc=0} 06:28:21.497770 --- ParallelTerminationStrategy: PID 17740 died... 06:28:21.517595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17740): Terminated: ok {rc=0} 06:28:21.605576 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:28:22.693819 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:22.706827 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:28:22.776895 tst ping_idle_ping.py: using LAC 39037 06:28:22.909065 tst ping_idle_ping.py: using RAC 22 06:28:23.038031 tst ping_idle_ping.py: using CellId 39037 06:28:23.166755 tst ping_idle_ping.py: using BVCI 39038 06:28:23.287676 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.299453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.311091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.322684 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.334223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.345806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.357447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:28:23.368856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:28:23.488911 tst ping_idle_ping.py:24: start network... 06:28:23.709992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:24.217847 run create_hlr_db(pid=17742): Launched 06:28:24.349292 bus /gobi_6: Setting Powered False 06:28:25.413810 run create_hlr_db(pid=17742): Terminated: ok {rc=0} 06:28:25.869176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17744): Launched 06:28:26.195497 run osmo-hlr_10.42.42.2(pid=17745): Launched 06:28:26.319860 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:26.883570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17747): Launched 06:28:27.210226 run osmo-stp_10.42.42.5(pid=17748): Launched 06:28:27.336117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:27.901043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17750): Launched 06:28:28.025865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:28.302882 run patchelf(pid=17751): Launched 06:28:28.486091 run osmo-stp_10.42.42.5(pid=17748): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17748)] 06:28:28.624731 run osmo-stp_10.42.42.5(pid=17748): stdout: | (launched: 2022-12-14_06:28:27.150589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:28.765516 run osmo-stp_10.42.42.5(pid=17748): stderr: | 20221214062827341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062827341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062827341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062827342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062827342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062827342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062827343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:28.905915 run osmo-stp_10.42.42.5(pid=17748): stdout: | (launched: 2022-12-14_06:28:27.150589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:29.039967 run osmo-stp_10.42.42.5(pid=17748): stderr: | 20221214062827341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062827341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062827341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062827342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062827342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062827342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062827343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:29.198835 run patchelf(pid=17751): Terminating (SIGINT) 06:28:29.381577 run patchelf(pid=17751): Terminated: ok {rc=0} 06:28:29.513579 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17748): Process ended prematurely: osmo-stp_10.42.42.5(pid=17748) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17748)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:28:29.523432 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:28:29.551698 run osmo-hlr_10.42.42.2(pid=17745): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17745)] 06:28:29.602160 run osmo-hlr_10.42.42.2(pid=17745): stdout: | (launched: 2022-12-14_06:28:26.135413) 06:28:29.654890 run osmo-hlr_10.42.42.2(pid=17745): stderr: | 20221214062826330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062826330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062826330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062826331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062826331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062826331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062826343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062826353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062826353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062826353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:29.706990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17744): Terminating (SIGTERM) 06:28:29.748670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17747): Terminating (SIGTERM) 06:28:29.790393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17750): Terminating (SIGTERM) 06:28:29.832376 --- ParallelTerminationStrategy: PID 17744 died... 06:28:29.852340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17744): Terminated: ok {rc=0} 06:28:29.898722 --- ParallelTerminationStrategy: PID 17747 died... 06:28:29.918205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17747): Terminated: ok {rc=0} 06:28:29.964094 --- ParallelTerminationStrategy: PID 17750 died... 06:28:29.983720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17750): Terminated: ok {rc=0} 06:28:30.070715 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:28:31.433305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:31.440141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:28:31.470596 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:28:31.513044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:28:31.603194 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:28:31.634113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:28:31.674594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:28:32.275686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:28:32.329839 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.341774 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:28:32.409610 tst cs_paging_gprs_active.py: using LAC 39038 06:28:32.540841 tst cs_paging_gprs_active.py: using RAC 23 06:28:32.671875 tst cs_paging_gprs_active.py: using CellId 39038 06:28:32.805631 tst cs_paging_gprs_active.py: using BVCI 39039 06:28:32.926244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.938173 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.949595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.960843 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.972425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.984209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:32.996004 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:33.008437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:33.019990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:33.138206 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:33.260488 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:28:33.486303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:33.820797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17757): Launched 06:28:34.110253 run iperf3-srv_10.42.42.10(pid=17758): Launched 06:28:34.236360 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:28:34.461743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:34.797652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17759): Launched 06:28:35.086911 run iperf3-srv_10.42.42.10(pid=17760): Launched 06:28:35.213077 tst cs_paging_gprs_active.py:38: start network... 06:28:35.438464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:35.955542 run create_hlr_db(pid=17761): Launched 06:28:36.089975 bus /gobi_6: Setting Powered False 06:28:37.155477 run create_hlr_db(pid=17761): Terminated: ok {rc=0} 06:28:37.618441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17763): Launched 06:28:37.951972 run osmo-hlr_10.42.42.2(pid=17764): Launched 06:28:38.079667 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:38.652857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17766): Launched 06:28:38.987782 run osmo-stp_10.42.42.5(pid=17767): Launched 06:28:39.114398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:39.690360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17769): Launched 06:28:39.818045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:40.107362 run patchelf(pid=17770): Launched 06:28:40.292250 run osmo-stp_10.42.42.5(pid=17767): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17767)] 06:28:40.432652 run osmo-stp_10.42.42.5(pid=17767): stdout: | (launched: 2022-12-14_06:28:38.926984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:40.575527 run osmo-stp_10.42.42.5(pid=17767): stderr: | 20221214062839119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062839119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062839119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062839120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062839120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062839120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062839120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:40.718542 run osmo-stp_10.42.42.5(pid=17767): stdout: | (launched: 2022-12-14_06:28:38.926984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:40.855076 run osmo-stp_10.42.42.5(pid=17767): stderr: | 20221214062839119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062839119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062839119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062839120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062839120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062839120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062839120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:41.016314 run patchelf(pid=17770): Terminating (SIGINT) 06:28:41.203094 run patchelf(pid=17770): Terminated: ok {rc=0} 06:28:41.337643 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17767): Process ended prematurely: osmo-stp_10.42.42.5(pid=17767) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17767)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:28:41.348144 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 06:28:41.377081 run osmo-hlr_10.42.42.2(pid=17764): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17764)] 06:28:41.427261 run osmo-hlr_10.42.42.2(pid=17764): stdout: | (launched: 2022-12-14_06:28:37.891180) 06:28:41.479089 run osmo-hlr_10.42.42.2(pid=17764): stderr: | 20221214062838088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062838088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062838088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062838088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062838089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062838089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062838101 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062838109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062838109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062838109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:41.531446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17757): Terminating (SIGTERM) 06:28:41.573429 run iperf3-srv_10.42.42.10(pid=17758): Terminating (SIGTERM) 06:28:41.615535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17759): Terminating (SIGTERM) 06:28:41.657754 run iperf3-srv_10.42.42.10(pid=17760): Terminating (SIGTERM) 06:28:41.699476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17763): Terminating (SIGTERM) 06:28:41.741484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17766): Terminating (SIGTERM) 06:28:41.783518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17769): Terminating (SIGTERM) 06:28:41.826246 --- ParallelTerminationStrategy: PID 17757 died... 06:28:41.846346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17757): Terminated: ok {rc=0} 06:28:41.892856 --- ParallelTerminationStrategy: PID 17758 died... 06:28:41.912726 run iperf3-srv_10.42.42.10(pid=17758): Terminated {rc=256} 06:28:41.958760 --- ParallelTerminationStrategy: PID 17759 died... 06:28:41.978405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17759): Terminated: ok {rc=0} 06:28:42.024479 --- ParallelTerminationStrategy: PID 17760 died... 06:28:42.044152 run iperf3-srv_10.42.42.10(pid=17760): Terminated {rc=256} 06:28:42.090364 --- ParallelTerminationStrategy: PID 17763 died... 06:28:42.110145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17763): Terminated: ok {rc=0} 06:28:42.156270 --- ParallelTerminationStrategy: PID 17766 died... 06:28:42.176030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17766): Terminated: ok {rc=0} 06:28:42.222139 --- ParallelTerminationStrategy: PID 17769 died... 06:28:42.241847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17769): Terminated: ok {rc=0} 06:28:42.330195 bus /gobi_0: Setting Powered False 06:28:43.429520 bus /gobi_0: Setting Powered False 06:28:44.546707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:28:45.698976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:45.711343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:28:45.780171 tst iperf3.py: using LAC 39039 06:28:45.917096 tst iperf3.py: using RAC 24 06:28:46.068286 tst iperf3.py: using CellId 39039 06:28:46.231203 tst iperf3.py: using BVCI 39040 06:28:46.372505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.385186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.397611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.410068 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.423497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.436668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.450132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.463252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:46.476704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:46.600151 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:28:46.817858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:47.147669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17771): Launched 06:28:47.436297 run iperf3-srv_10.42.42.10(pid=17772): Launched 06:28:47.554386 tst iperf3.py:8: start network... 06:28:47.764863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:48.249991 run create_hlr_db(pid=17773): Launched 06:28:48.370184 bus /gobi_6: Setting Powered False 06:28:49.432820 run create_hlr_db(pid=17773): Terminated: ok {rc=0} 06:28:49.868731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Launched 06:28:50.182062 run osmo-hlr_10.42.42.2(pid=17776): Launched 06:28:50.300931 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:50.854480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Launched 06:28:51.168514 run osmo-stp_10.42.42.5(pid=17779): Launched 06:28:51.287923 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:51.827525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17781): Launched 06:28:51.948087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:52.213764 run patchelf(pid=17782): Launched 06:28:52.387056 run osmo-stp_10.42.42.5(pid=17779): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] 06:28:52.518858 run osmo-stp_10.42.42.5(pid=17779): stdout: | (launched: 2022-12-14_06:28:51.111052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:52.652650 run osmo-stp_10.42.42.5(pid=17779): stderr: | 20221214062851281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062851281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062851281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062851282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062851282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062851282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062851282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:52.786734 run osmo-stp_10.42.42.5(pid=17779): stdout: | (launched: 2022-12-14_06:28:51.111052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:52.915106 run osmo-stp_10.42.42.5(pid=17779): stderr: | 20221214062851281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062851281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062851281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062851282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062851282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062851282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062851282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:53.066448 run patchelf(pid=17782): Terminating (SIGINT) 06:28:53.241101 run patchelf(pid=17782): Terminated: ok {rc=0} 06:28:53.367279 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17779): Process ended prematurely: osmo-stp_10.42.42.5(pid=17779) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 06:28:53.377083 tst iperf3.py:8: Test FAILED (7.7 sec) 06:28:53.404314 run osmo-hlr_10.42.42.2(pid=17776): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17776)] 06:28:53.452426 run osmo-hlr_10.42.42.2(pid=17776): stdout: | (launched: 2022-12-14_06:28:50.124806) 06:28:53.502351 run osmo-hlr_10.42.42.2(pid=17776): stderr: | 20221214062850299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062850299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062850299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062850299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062850300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062850300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062850312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062850320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062850320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062850320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:53.552281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17771): Terminating (SIGTERM) 06:28:53.592869 run iperf3-srv_10.42.42.10(pid=17772): Terminating (SIGTERM) 06:28:53.633188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Terminating (SIGTERM) 06:28:53.673754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Terminating (SIGTERM) 06:28:53.714212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17781): Terminating (SIGTERM) 06:28:53.755499 --- ParallelTerminationStrategy: PID 17771 died... 06:28:53.775301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17771): Terminated: ok {rc=0} 06:28:53.820108 --- ParallelTerminationStrategy: PID 17772 died... 06:28:53.839525 run iperf3-srv_10.42.42.10(pid=17772): Terminated {rc=256} 06:28:53.883909 --- ParallelTerminationStrategy: PID 17775 died... 06:28:53.903054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Terminated: ok {rc=0} 06:28:53.947396 --- ParallelTerminationStrategy: PID 17778 died... 06:28:53.966606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Terminated: ok {rc=0} 06:28:54.011235 --- ParallelTerminationStrategy: PID 17781 died... 06:28:54.030325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17781): Terminated: ok {rc=0} 06:28:54.115829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:28:55.268239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.280845 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:28:55.351308 tst iperf3m4.py: using LAC 39040 06:28:55.481302 tst iperf3m4.py: using RAC 25 06:28:55.611494 tst iperf3m4.py: using CellId 39040 06:28:55.735136 tst iperf3m4.py: using BVCI 39041 06:28:55.849785 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.861159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.872327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.883406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.894915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.906109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.917502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.928562 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:55.940066 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:56.063013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:56.187957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:56.311198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:56.433483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:28:56.659072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:56.994404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17783): Launched 06:28:57.284917 run iperf3-srv_10.42.42.10(pid=17784): Launched 06:28:57.411269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:28:57.637012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:57.972718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17785): Launched 06:28:58.262753 run iperf3-srv_10.42.42.10(pid=17786): Launched 06:28:58.387067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:28:58.612242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:58.948152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17787): Launched 06:28:59.238015 run iperf3-srv_10.42.42.10(pid=17788): Launched 06:28:59.363638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:28:59.589081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:28:59.924645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17789): Launched 06:29:00.214303 run iperf3-srv_10.42.42.10(pid=17790): Launched 06:29:00.340658 tst iperf3m4.py:8: start network... 06:29:00.566015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:01.140356 run create_hlr_db(pid=17791): Launched 06:29:01.346844 bus /gobi_6: Setting Powered False 06:29:02.411021 run create_hlr_db(pid=17791): Terminated: ok {rc=0} 06:29:02.866182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17793): Launched 06:29:03.180109 run osmo-hlr_10.42.42.2(pid=17794): Launched 06:29:03.299290 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:03.850940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17796): Launched 06:29:04.163696 run osmo-stp_10.42.42.5(pid=17797): Launched 06:29:04.282512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:29:04.820812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17799): Launched 06:29:04.940875 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:29:05.206861 run patchelf(pid=17800): Launched 06:29:05.380325 run osmo-stp_10.42.42.5(pid=17797): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17797)] 06:29:05.511901 run osmo-stp_10.42.42.5(pid=17797): stdout: | (launched: 2022-12-14_06:29:04.106079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:05.645627 run osmo-stp_10.42.42.5(pid=17797): stderr: | 20221214062904273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062904273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062904273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062904274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062904274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062904274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062904274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:05.779359 run osmo-stp_10.42.42.5(pid=17797): stdout: | (launched: 2022-12-14_06:29:04.106079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:05.906794 run osmo-stp_10.42.42.5(pid=17797): stderr: | 20221214062904273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062904273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062904273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062904274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062904274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062904274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062904274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:06.057769 run patchelf(pid=17800): Terminating (SIGINT) 06:29:06.232197 run patchelf(pid=17800): Terminated: ok {rc=0} 06:29:06.358473 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17797): Process ended prematurely: osmo-stp_10.42.42.5(pid=17797) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17797)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:29:06.368175 tst iperf3m4.py:8: Test FAILED (11.1 sec) 06:29:06.395709 run osmo-hlr_10.42.42.2(pid=17794): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17794)] 06:29:06.443920 run osmo-hlr_10.42.42.2(pid=17794): stdout: | (launched: 2022-12-14_06:29:03.122758) 06:29:06.493547 run osmo-hlr_10.42.42.2(pid=17794): stderr: | 20221214062903296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062903296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062903296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062903296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062903296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062903296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062903308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062903316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062903316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062903316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:06.543643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17783): Terminating (SIGTERM) 06:29:06.584417 run iperf3-srv_10.42.42.10(pid=17784): Terminating (SIGTERM) 06:29:06.624572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17785): Terminating (SIGTERM) 06:29:06.664693 run iperf3-srv_10.42.42.10(pid=17786): Terminating (SIGTERM) 06:29:06.704644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17787): Terminating (SIGTERM) 06:29:06.744766 run iperf3-srv_10.42.42.10(pid=17788): Terminating (SIGTERM) 06:29:06.785302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17789): Terminating (SIGTERM) 06:29:06.825754 run iperf3-srv_10.42.42.10(pid=17790): Terminating (SIGTERM) 06:29:06.866103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17793): Terminating (SIGTERM) 06:29:06.906431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17796): Terminating (SIGTERM) 06:29:06.946478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17799): Terminating (SIGTERM) 06:29:06.986821 --- ParallelTerminationStrategy: PID 17783 died... 06:29:07.006480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17783): Terminated: ok {rc=0} 06:29:07.050834 --- ParallelTerminationStrategy: PID 17784 died... 06:29:07.069748 run iperf3-srv_10.42.42.10(pid=17784): Terminated {rc=256} 06:29:07.113774 --- ParallelTerminationStrategy: PID 17785 died... 06:29:07.132744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17785): Terminated: ok {rc=0} 06:29:07.176670 --- ParallelTerminationStrategy: PID 17786 died... 06:29:07.195594 run iperf3-srv_10.42.42.10(pid=17786): Terminated {rc=256} 06:29:07.239487 --- ParallelTerminationStrategy: PID 17787 died... 06:29:07.258429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17787): Terminated: ok {rc=0} 06:29:07.302488 --- ParallelTerminationStrategy: PID 17788 died... 06:29:07.321582 run iperf3-srv_10.42.42.10(pid=17788): Terminated {rc=256} 06:29:07.365433 --- ParallelTerminationStrategy: PID 17789 died... 06:29:07.384815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17789): Terminated: ok {rc=0} 06:29:07.428830 --- ParallelTerminationStrategy: PID 17790 died... 06:29:07.448163 run iperf3-srv_10.42.42.10(pid=17790): Terminated {rc=256} 06:29:07.492183 --- ParallelTerminationStrategy: PID 17793 died... 06:29:07.511191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17793): Terminated: ok {rc=0} 06:29:07.555313 --- ParallelTerminationStrategy: PID 17796 died... 06:29:07.574338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17796): Terminated: ok {rc=0} 06:29:07.618302 --- ParallelTerminationStrategy: PID 17799 died... 06:29:07.637335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17799): Terminated: ok {rc=0} 06:29:07.720824 bus /gobi_4: Setting Powered False 06:29:08.817315 bus /gobi_4: Setting Powered False 06:29:09.927395 bus /gobi_1: Setting Powered False 06:29:11.026075 bus /gobi_1: Setting Powered False 06:29:12.144188 bus /gobi_0: Setting Powered False 06:29:13.244240 bus /gobi_0: Setting Powered False 06:29:14.358375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:29:15.460611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:15.473168 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:29:15.541735 tst ping.py: using LAC 39041 06:29:15.671567 tst ping.py: using RAC 26 06:29:15.801264 tst ping.py: using CellId 39041 06:29:15.953191 tst ping.py: using BVCI 39042 06:29:16.080310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.092647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.104806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.117094 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.130533 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.143779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.159377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:16.172688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:29:16.291338 tst ping.py:19: start network... 06:29:16.576146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:17.113898 run create_hlr_db(pid=17801): Launched 06:29:17.275274 bus /gobi_6: Setting Powered False 06:29:18.339439 run create_hlr_db(pid=17801): Terminated: ok {rc=0} 06:29:18.775874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17803): Launched 06:29:19.082860 run osmo-hlr_10.42.42.2(pid=17804): Launched 06:29:19.200094 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:19.742146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17806): Launched 06:29:20.048612 run osmo-stp_10.42.42.5(pid=17807): Launched 06:29:20.166663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:29:20.695993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17809): Launched 06:29:20.814038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:29:21.074341 run patchelf(pid=17810): Launched 06:29:21.244813 run osmo-stp_10.42.42.5(pid=17807): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17807)] 06:29:21.374536 run osmo-stp_10.42.42.5(pid=17807): stdout: | (launched: 2022-12-14_06:29:19.991984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:21.505928 run osmo-stp_10.42.42.5(pid=17807): stderr: | 20221214062920162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062920162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062920162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062920163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062920163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062920163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062920163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:21.637654 run osmo-stp_10.42.42.5(pid=17807): stdout: | (launched: 2022-12-14_06:29:19.991984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:21.762981 run osmo-stp_10.42.42.5(pid=17807): stderr: | 20221214062920162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062920162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062920162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062920163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062920163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062920163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062920163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:21.911429 run patchelf(pid=17810): Terminating (SIGINT) 06:29:22.082811 run patchelf(pid=17810): Terminated: ok {rc=0} 06:29:22.206714 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17807): Process ended prematurely: osmo-stp_10.42.42.5(pid=17807) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17807)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 06:29:22.215830 tst ping.py:22: Test FAILED (6.7 sec) 06:29:22.242553 run osmo-hlr_10.42.42.2(pid=17804): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17804)] 06:29:22.290571 run osmo-hlr_10.42.42.2(pid=17804): stdout: | (launched: 2022-12-14_06:29:19.026255) 06:29:22.340147 run osmo-hlr_10.42.42.2(pid=17804): stderr: | 20221214062919202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062919202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062919202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062919202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062919202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062919202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062919214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062919222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062919222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062919222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:22.390129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17803): Terminating (SIGTERM) 06:29:22.430126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17806): Terminating (SIGTERM) 06:29:22.470248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17809): Terminating (SIGTERM) 06:29:22.511094 --- ParallelTerminationStrategy: PID 17803 died... 06:29:22.530724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17803): Terminated: ok {rc=0} 06:29:22.575730 --- ParallelTerminationStrategy: PID 17806 died... 06:29:22.594961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17806): Terminated: ok {rc=0} 06:29:22.639787 --- ParallelTerminationStrategy: PID 17809 died... 06:29:22.659198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17809): Terminated: ok {rc=0} 06:29:22.746954 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:29:23.838281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:23.851542 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:29:23.926354 tst ping_idle_ping.py: using LAC 39042 06:29:24.054364 tst ping_idle_ping.py: using RAC 27 06:29:24.181802 tst ping_idle_ping.py: using CellId 39042 06:29:24.312126 tst ping_idle_ping.py: using BVCI 39043 06:29:24.434036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.445810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.457432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.468902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.481112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.493363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.505628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:29:24.517787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:29:24.642609 tst ping_idle_ping.py:24: start network... 06:29:24.864793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:25.375051 run create_hlr_db(pid=17811): Launched 06:29:25.508520 bus /gobi_6: Setting Powered False 06:29:26.573475 run create_hlr_db(pid=17811): Terminated: ok {rc=0} 06:29:27.014313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17813): Launched 06:29:27.323004 run osmo-hlr_10.42.42.2(pid=17814): Launched 06:29:27.441516 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:28.008034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17816): Launched 06:29:28.334979 run osmo-stp_10.42.42.5(pid=17817): Launched 06:29:28.459373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:29:29.023566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17819): Launched 06:29:29.148819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:29:29.426186 run patchelf(pid=17820): Launched 06:29:29.609664 run osmo-stp_10.42.42.5(pid=17817): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17817)] 06:29:29.747736 run osmo-stp_10.42.42.5(pid=17817): stdout: | (launched: 2022-12-14_06:29:28.275231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:29.887943 run osmo-stp_10.42.42.5(pid=17817): stderr: | 20221214062928467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062928467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062928467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062928468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062928468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062928468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062928469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:30.027976 run osmo-stp_10.42.42.5(pid=17817): stdout: | (launched: 2022-12-14_06:29:28.275231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:30.161938 run osmo-stp_10.42.42.5(pid=17817): stderr: | 20221214062928467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062928467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062928467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062928468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062928468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062928468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062928469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:30.320499 run patchelf(pid=17820): Terminating (SIGINT) 06:29:30.503278 run patchelf(pid=17820): Terminated: ok {rc=0} 06:29:30.635163 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17817): Process ended prematurely: osmo-stp_10.42.42.5(pid=17817) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17817)] [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:29:30.644830 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:29:30.673115 run osmo-hlr_10.42.42.2(pid=17814): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17814)] 06:29:30.723141 run osmo-hlr_10.42.42.2(pid=17814): stdout: | (launched: 2022-12-14_06:29:27.266589) 06:29:30.775006 run osmo-hlr_10.42.42.2(pid=17814): stderr: | 20221214062927443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062927443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062927443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062927443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062927443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062927443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062927455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062927463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062927463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062927463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:30.827312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17813): Terminating (SIGTERM) 06:29:30.870585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17816): Terminating (SIGTERM) 06:29:30.914528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17819): Terminating (SIGTERM) 06:29:30.957452 --- ParallelTerminationStrategy: PID 17813 died... 06:29:30.977646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17813): Terminated: ok {rc=0} 06:29:31.024323 --- ParallelTerminationStrategy: PID 17816 died... 06:29:31.044243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17816): Terminated: ok {rc=0} 06:29:31.093547 --- ParallelTerminationStrategy: PID 17819 died... 06:29:31.113804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17819): Terminated: ok {rc=0} 06:29:31.203333 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:29:32.519335 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:32.526671 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:29:32.556550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:29:32.592215 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:29:32.644591 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:29:32.674685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:29:32.710174 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:29:33.273032 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:29:33.278323 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.290278 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:29:33.355420 tst switch_tch_pdch.py: using LAC 39043 06:29:33.481795 tst switch_tch_pdch.py: using RAC 28 06:29:33.604149 tst switch_tch_pdch.py: using CellId 39043 06:29:33.722474 tst switch_tch_pdch.py: using BVCI 39044 06:29:33.835869 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.847417 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.858904 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.870259 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.881801 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.893379 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.904936 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:29:33.916550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:29:34.037945 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:29:34.157444 tst switch_tch_pdch.py:51: start network... 06:29:34.378330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:34.884381 run create_hlr_db(pid=17825): Launched 06:29:35.017096 bus /gobi_6: Setting Powered False 06:29:36.081587 run create_hlr_db(pid=17825): Terminated: ok {rc=0} 06:29:36.536902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17827): Launched 06:29:36.864259 run osmo-hlr_10.42.42.2(pid=17828): Launched 06:29:36.988394 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:37.551254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17830): Launched 06:29:37.878680 run osmo-stp_10.42.42.5(pid=17831): Launched 06:29:38.003474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:29:38.567951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17833): Launched 06:29:38.694530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:29:38.971088 run patchelf(pid=17834): Launched 06:29:39.153861 run osmo-stp_10.42.42.5(pid=17831): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17831)] 06:29:39.292068 run osmo-stp_10.42.42.5(pid=17831): stdout: | (launched: 2022-12-14_06:29:37.819333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:39.431758 run osmo-stp_10.42.42.5(pid=17831): stderr: | 20221214062938010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062938010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062938010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062938010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062938011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062938011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062938011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:39.571689 run osmo-stp_10.42.42.5(pid=17831): stdout: | (launched: 2022-12-14_06:29:37.819333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:39.705572 run osmo-stp_10.42.42.5(pid=17831): stderr: | 20221214062938010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062938010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062938010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062938010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062938011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062938011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062938011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:39.863678 run patchelf(pid=17834): Terminating (SIGINT) 06:29:40.045476 run patchelf(pid=17834): Terminated: ok {rc=0} 06:29:40.176570 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17831): Process ended prematurely: osmo-stp_10.42.42.5(pid=17831) [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17831)] [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:29:40.186474 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 06:29:40.214448 run osmo-hlr_10.42.42.2(pid=17828): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17828)] 06:29:40.264286 run osmo-hlr_10.42.42.2(pid=17828): stdout: | (launched: 2022-12-14_06:29:36.804153) 06:29:40.316245 run osmo-hlr_10.42.42.2(pid=17828): stderr: | 20221214062937002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062937002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062937002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062937002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062937002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062937002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062937015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062937023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062937023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062937023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:40.368560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17827): Terminating (SIGTERM) 06:29:40.410359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17830): Terminating (SIGTERM) 06:29:40.452078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17833): Terminating (SIGTERM) 06:29:40.494116 --- ParallelTerminationStrategy: PID 17827 died... 06:29:40.514275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17827): Terminated: ok {rc=0} 06:29:40.560443 --- ParallelTerminationStrategy: PID 17830 died... 06:29:40.580218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17830): Terminated: ok {rc=0} 06:29:40.626605 --- ParallelTerminationStrategy: PID 17833 died... 06:29:40.646216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17833): Terminated: ok {rc=0} 06:29:40.733965 bus /gobi_0: Setting Powered False 06:29:41.831152 bus /gobi_0: Setting Powered False 06:29:42.944456 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:29:44.204295 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:44.210704 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:29:44.240464 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:29:44.276093 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:29:44.330821 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:29:44.359986 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:29:44.394305 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:29:44.954841 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:29:44.960455 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:44.972464 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:29:45.044824 tst switch_tch_pdch.py: using LAC 39044 06:29:45.172240 tst switch_tch_pdch.py: using RAC 29 06:29:45.298891 tst switch_tch_pdch.py: using CellId 39044 06:29:45.427420 tst switch_tch_pdch.py: using BVCI 39045 06:29:45.546444 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.558311 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.569905 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.581459 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.592790 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.604393 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.616376 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:29:45.627978 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:29:45.744350 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:29:45.886395 tst switch_tch_pdch.py:51: start network... 06:29:46.145669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:46.646798 run create_hlr_db(pid=17838): Launched 06:29:46.814057 bus /gobi_6: Setting Powered False 06:29:47.879612 run create_hlr_db(pid=17838): Terminated: ok {rc=0} 06:29:48.306213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17840): Launched 06:29:48.633250 run osmo-hlr_10.42.42.2(pid=17841): Launched 06:29:48.757573 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:49.298434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17843): Launched 06:29:49.625372 run osmo-stp_10.42.42.5(pid=17844): Launched 06:29:49.750766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:29:50.285542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17846): Launched 06:29:50.409866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:29:50.686576 run patchelf(pid=17847): Launched 06:29:50.867270 run osmo-stp_10.42.42.5(pid=17844): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17844)] 06:29:51.005204 run osmo-stp_10.42.42.5(pid=17844): stdout: | (launched: 2022-12-14_06:29:49.565080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:51.144604 run osmo-stp_10.42.42.5(pid=17844): stderr: | 20221214062949757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062949758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062949758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062949758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062949759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062949759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062949759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:51.283949 run osmo-stp_10.42.42.5(pid=17844): stdout: | (launched: 2022-12-14_06:29:49.565080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:51.417737 run osmo-stp_10.42.42.5(pid=17844): stderr: | 20221214062949757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214062949758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214062949758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214062949758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214062949759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214062949759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214062949759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:51.576292 run patchelf(pid=17847): Terminating (SIGINT) 06:29:51.758430 run patchelf(pid=17847): Terminated: ok {rc=0} 06:29:51.889601 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17844): Process ended prematurely: osmo-stp_10.42.42.5(pid=17844) [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17844)] [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:29:51.899405 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 06:29:51.927496 run osmo-hlr_10.42.42.2(pid=17841): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17841)] 06:29:51.977589 run osmo-hlr_10.42.42.2(pid=17841): stdout: | (launched: 2022-12-14_06:29:48.572775) 06:29:52.029619 run osmo-hlr_10.42.42.2(pid=17841): stderr: | 20221214062948770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214062948770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214062948770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214062948770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214062948770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214062948770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214062948783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214062948791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214062948792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214062948792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:52.081883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17840): Terminating (SIGTERM) 06:29:52.123691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17843): Terminating (SIGTERM) 06:29:52.165614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17846): Terminating (SIGTERM) 06:29:52.207836 --- ParallelTerminationStrategy: PID 17840 died... 06:29:52.228178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17840): Terminated: ok {rc=0} 06:29:52.274517 --- ParallelTerminationStrategy: PID 17843 died... 06:29:52.294259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17843): Terminated: ok {rc=0} 06:29:52.340094 --- ParallelTerminationStrategy: PID 17846 died... 06:29:52.359855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17846): Terminated: ok {rc=0} 06:29:52.446600 bus /gobi_0: Setting Powered False 06:29:53.544144 bus /gobi_0: Setting Powered False 06:29:54.660430 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_sms:nanobts --------------------------------------------------------------------- 06:29:55.910726 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:55.914892 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 06:29:55.939206 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 06:29:55.946225 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 06:29:55.998902 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 06:29:56.023347 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 06:29:56.030477 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 06:29:56.568627 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 06:29:56.574253 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 06:29:56.585818 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 06:29:56.629325 tst mo_mt_sms.py: using LAC 39045 06:29:56.766593 tst mo_mt_sms.py: using RAC 30 06:29:56.896137 tst mo_mt_sms.py: using CellId 39045 06:29:57.016230 tst mo_mt_sms.py: using BVCI 39046 06:29:57.128101 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 06:29:57.245948 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 06:29:57.365617 tst mo_mt_sms.py:9: start nitb and bts... 06:29:57.587155 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:29:58.252755 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17851): Launched 06:29:58.578586 run osmo-nitb_10.42.42.2(pid=17852): Launched 06:29:58.761425 run osmo-nitb_10.42.42.2(pid=17852): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17852)] 06:29:58.907197 run osmo-nitb_10.42.42.2(pid=17852): stdout: | (launched: 2022-12-14_06:29:58.519031) 06:29:59.054342 run osmo-nitb_10.42.42.2(pid=17852): stderr: | (launched: 2022-12-14_06:29:58.567376) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:29:59.201807 run osmo-nitb_10.42.42.2(pid=17852): stdout: | (launched: 2022-12-14_06:29:58.519031) 06:29:59.343095 run osmo-nitb_10.42.42.2(pid=17852): stderr: | (launched: 2022-12-14_06:29:58.567376) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17852): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17852) [trial-2400↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17852)] 06:29:59.704366 tst osmo-nitb_10.42.42.2(pid=17852): stdout: | (launched: 2022-12-14_06:29:58.519031) 06:29:59.835419 tst osmo-nitb_10.42.42.2(pid=17852): stderr: | (launched: 2022-12-14_06:29:58.567376) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:29:59.990465 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17852): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17852) [trial-2400↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17852)] [trial-2400↪nitb_sms:nanobts↪mo_mt_sms.py:11] 06:29:59.999563 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 06:30:00.006533 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17851): Terminating (SIGTERM) 06:30:00.217795 --- ParallelTerminationStrategy: PID 17851 died... 06:30:00.239720 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17851): Terminated: ok {rc=0} 06:30:00.328119 bus /sierra_3: Setting Powered False 06:30:01.439873 bus /sierra_3: Setting Powered False 06:30:02.568119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:nanobts+band-1900 --------------------------------------------------------------------- 06:30:03.758657 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:03.764106 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:30:03.788513 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:30:03.817449 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 06:30:03.872571 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:30:03.896372 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:30:03.923453 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 06:30:04.472284 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 06:30:04.478596 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:04.490356 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:04.528680 tst mo_mt_sms.py: using LAC 39046 06:30:04.658294 tst mo_mt_sms.py: using RAC 31 06:30:04.788505 tst mo_mt_sms.py: using CellId 39046 06:30:04.918013 tst mo_mt_sms.py: using BVCI 39047 06:30:05.037981 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:05.049234 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:05.060243 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:05.071367 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:05.082462 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:05.093461 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 06:30:05.210223 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 06:30:05.330324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:05.838622 run create_hlr_db(pid=17859): Launched 06:30:05.971958 bus /sierra_2: Setting Powered False 06:30:07.035787 run create_hlr_db(pid=17859): Terminated: ok {rc=0} 06:30:07.474080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Launched 06:30:07.801616 run osmo-hlr_10.42.42.2(pid=17862): Launched 06:30:07.927093 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:08.492588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Launched 06:30:08.818321 run osmo-stp_10.42.42.5(pid=17865): Launched 06:30:08.943265 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:09.533904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17868): Launched 06:30:09.862367 run osmo-msc_10.42.42.6(pid=17869): Launched 06:30:10.043908 run osmo-stp_10.42.42.5(pid=17865): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] 06:30:10.181562 run osmo-stp_10.42.42.5(pid=17865): stdout: | (launched: 2022-12-14_06:30:08.758437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:10.319525 run osmo-stp_10.42.42.5(pid=17865): stderr: | 20221214063008951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063008951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063008952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063008952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063008953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063008954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063008954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:10.456097 run osmo-stp_10.42.42.5(pid=17865): stdout: | (launched: 2022-12-14_06:30:08.758437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:10.585981 run osmo-stp_10.42.42.5(pid=17865): stderr: | 20221214063008951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063008951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063008952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063008952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063008953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063008954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063008954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:10.742311 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17865): Process ended prematurely: osmo-stp_10.42.42.5(pid=17865) [trial-2400↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] [trial-2400↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 06:30:10.751501 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 06:30:10.778820 run osmo-hlr_10.42.42.2(pid=17862): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17862)] 06:30:10.828796 run osmo-hlr_10.42.42.2(pid=17862): stdout: | (launched: 2022-12-14_06:30:07.741991) 06:30:10.880905 run osmo-hlr_10.42.42.2(pid=17862): stderr: | 20221214063007940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063007940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063007940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063007940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063007940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063007940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063007952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063007961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063007961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063007961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:10.953590 run osmo-msc_10.42.42.6(pid=17869): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17869)] 06:30:11.003591 run osmo-msc_10.42.42.6(pid=17869): stdout: | (launched: 2022-12-14_06:30:09.801697) 06:30:11.055382 run osmo-msc_10.42.42.6(pid=17869): stderr: | 20221214063010124 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063010124 DLGLOBAL DEBUG validating counter group 0x7fde0bb19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063010124 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063010125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063010125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063010125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063010127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063010127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063010127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063010127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:11.107987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Terminating (SIGTERM) 06:30:11.149642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Terminating (SIGTERM) 06:30:11.191249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17868): Terminating (SIGTERM) 06:30:11.233276 --- ParallelTerminationStrategy: PID 17861 died... 06:30:11.252809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17861): Terminated: ok {rc=0} 06:30:11.299090 --- ParallelTerminationStrategy: PID 17864 died... 06:30:11.318763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17864): Terminated: ok {rc=0} 06:30:11.365013 --- ParallelTerminationStrategy: PID 17868 died... 06:30:11.384723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17868): Terminated: ok {rc=0} 06:30:11.473174 bus /sierra_3: Setting Powered False 06:30:12.571767 bus /sierra_3: Setting Powered False 06:30:13.687454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 06:30:14.914717 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:14.920126 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:30:14.944491 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 06:30:14.951478 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 06:30:14.987293 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:30:15.011737 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 06:30:15.018723 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 06:30:15.543783 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 06:30:15.550062 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 06:30:15.562063 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:15.600056 tst assert_extension.py: using LAC 39047 06:30:15.722435 tst assert_extension.py: using RAC 32 06:30:15.864559 tst assert_extension.py: using CellId 39047 06:30:16.015135 tst assert_extension.py: using BVCI 39048 06:30:16.165958 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 06:30:16.284889 tst assert_extension.py:10: start nitb and bts... 06:30:16.510942 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:30:17.237954 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17874): Launched 06:30:17.557195 run osmo-nitb_10.42.42.2(pid=17875): Launched 06:30:17.730477 run osmo-nitb_10.42.42.2(pid=17875): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17875)] 06:30:17.868829 run osmo-nitb_10.42.42.2(pid=17875): stdout: | (launched: 2022-12-14_06:30:17.500305) 06:30:18.008689 run osmo-nitb_10.42.42.2(pid=17875): stderr: | (launched: 2022-12-14_06:30:17.546624) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:30:18.148448 run osmo-nitb_10.42.42.2(pid=17875): stdout: | (launched: 2022-12-14_06:30:17.500305) 06:30:18.282487 run osmo-nitb_10.42.42.2(pid=17875): stderr: | (launched: 2022-12-14_06:30:17.546624) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17875): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17875) [trial-2400↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17875)] 06:30:18.676595 tst osmo-nitb_10.42.42.2(pid=17875): stdout: | (launched: 2022-12-14_06:30:17.500305) 06:30:18.800049 tst osmo-nitb_10.42.42.2(pid=17875): stderr: | (launched: 2022-12-14_06:30:17.546624) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:30:18.945936 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17875): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17875) [trial-2400↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17875)] [trial-2400↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 06:30:18.954775 tst assert_extension.py:12: Test FAILED (3.4 sec) 06:30:18.961545 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17874): Terminating (SIGTERM) 06:30:19.170864 --- ParallelTerminationStrategy: PID 17874 died... 06:30:19.191726 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17874): Terminated: ok {rc=0} 06:30:19.279519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:nanobts+band-1900 --------------------------------------------------------------------- 06:30:20.444110 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:20.449240 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:30:20.472611 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:30:20.499769 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 06:30:20.534710 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:30:20.558525 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:30:20.585133 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 06:30:21.113743 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 06:30:21.118988 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:21.129932 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:21.167168 tst assert_extension.py: using LAC 39048 06:30:21.289360 tst assert_extension.py: using RAC 33 06:30:21.412919 tst assert_extension.py: using CellId 39048 06:30:21.534076 tst assert_extension.py: using BVCI 39049 06:30:21.649115 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:21.659788 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:21.670606 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:21.681412 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:21.692899 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:21.704435 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 06:30:21.825861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:22.333484 run create_hlr_db(pid=17879): Launched 06:30:22.466419 bus /sierra_2: Setting Powered False 06:30:23.531591 run create_hlr_db(pid=17879): Terminated: ok {rc=0} 06:30:23.990302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17881): Launched 06:30:24.318090 run osmo-hlr_10.42.42.2(pid=17882): Launched 06:30:24.443581 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:25.015552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17884): Launched 06:30:25.342808 run osmo-stp_10.42.42.5(pid=17885): Launched 06:30:25.467678 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:26.059991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17887): Launched 06:30:26.387383 run osmo-msc_10.42.42.6(pid=17888): Launched 06:30:26.571594 run osmo-stp_10.42.42.5(pid=17885): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17885)] 06:30:26.710088 run osmo-stp_10.42.42.5(pid=17885): stdout: | (launched: 2022-12-14_06:30:25.282286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:26.847724 run osmo-stp_10.42.42.5(pid=17885): stderr: | 20221214063025473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063025474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063025474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063025474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063025475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063025475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063025475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:26.984158 run osmo-stp_10.42.42.5(pid=17885): stdout: | (launched: 2022-12-14_06:30:25.282286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:27.114805 run osmo-stp_10.42.42.5(pid=17885): stderr: | 20221214063025473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063025474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063025474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063025474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063025475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063025475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063025475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:27.270826 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17885): Process ended prematurely: osmo-stp_10.42.42.5(pid=17885) [trial-2400↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17885)] [trial-2400↪ussd:nanobts+band-1900↪assert_extension.py:17] 06:30:27.280063 tst assert_extension.py:17: Test FAILED (6.2 sec) 06:30:27.307747 run osmo-hlr_10.42.42.2(pid=17882): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17882)] 06:30:27.358456 run osmo-hlr_10.42.42.2(pid=17882): stdout: | (launched: 2022-12-14_06:30:24.257729) 06:30:27.412159 run osmo-hlr_10.42.42.2(pid=17882): stderr: | 20221214063024456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063024456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063024456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063024456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063024456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063024456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063024469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063024478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063024478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063024478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:27.485382 run osmo-msc_10.42.42.6(pid=17888): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17888)] 06:30:27.535924 run osmo-msc_10.42.42.6(pid=17888): stdout: | (launched: 2022-12-14_06:30:26.327475) 06:30:27.588625 run osmo-msc_10.42.42.6(pid=17888): stderr: | 20221214063026648 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063026648 DLGLOBAL DEBUG validating counter group 0x7fc8c5797c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063026649 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063026649 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063026649 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063026649 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063026651 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063026651 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063026651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063026651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:27.642215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17881): Terminating (SIGTERM) 06:30:27.684522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17884): Terminating (SIGTERM) 06:30:27.727066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17887): Terminating (SIGTERM) 06:30:27.769760 --- ParallelTerminationStrategy: PID 17881 died... 06:30:27.790266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17881): Terminated: ok {rc=0} 06:30:27.837223 --- ParallelTerminationStrategy: PID 17884 died... 06:30:27.857305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17884): Terminated: ok {rc=0} 06:30:27.904251 --- ParallelTerminationStrategy: PID 17887 died... 06:30:27.924287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17887): Terminated: ok {rc=0} 06:30:28.013158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:30:29.212847 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:29.220751 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:30:29.244567 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:30:29.272792 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:30:29.323510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:30:29.347194 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:30:29.373655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:30:29.931208 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:30:29.985967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:29.998090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:30:30.060381 tst mo_mt_call.py: using LAC 39049 06:30:30.192288 tst mo_mt_call.py: using RAC 34 06:30:30.315770 tst mo_mt_call.py: using CellId 39049 06:30:30.438771 tst mo_mt_call.py: using BVCI 39050 06:30:30.553722 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:30.565300 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:30.576409 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:30.587671 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:30.599121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:30.610605 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:30:30.732105 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:30:30.850311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:31.391968 run create_hlr_db(pid=17893): Launched 06:30:31.558634 bus /sierra_2: Setting Powered False 06:30:32.623417 run create_hlr_db(pid=17893): Terminated: ok {rc=0} 06:30:33.072751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17895): Launched 06:30:33.386700 run osmo-hlr_10.42.42.2(pid=17896): Launched 06:30:33.505469 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:34.056195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17898): Launched 06:30:34.370183 run osmo-stp_10.42.42.5(pid=17899): Launched 06:30:34.489641 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:35.055789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17901): Launched 06:30:35.370096 run osmo-msc_10.42.42.6(pid=17902): Launched 06:30:35.545776 run osmo-stp_10.42.42.5(pid=17899): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17899)] 06:30:35.678165 run osmo-stp_10.42.42.5(pid=17899): stdout: | (launched: 2022-12-14_06:30:34.312669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:35.809507 run osmo-stp_10.42.42.5(pid=17899): stderr: | 20221214063034482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063034482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063034482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063034483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063034483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063034483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063034483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:35.939325 run osmo-stp_10.42.42.5(pid=17899): stdout: | (launched: 2022-12-14_06:30:34.312669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:36.063552 run osmo-stp_10.42.42.5(pid=17899): stderr: | 20221214063034482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063034482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063034482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063034483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063034483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063034483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063034483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:36.211906 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17899): Process ended prematurely: osmo-stp_10.42.42.5(pid=17899) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17899)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:30:36.220915 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:30:36.247398 run osmo-hlr_10.42.42.2(pid=17896): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17896)] 06:30:36.295638 run osmo-hlr_10.42.42.2(pid=17896): stdout: | (launched: 2022-12-14_06:30:33.329577) 06:30:36.345239 run osmo-hlr_10.42.42.2(pid=17896): stderr: | 20221214063033505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063033505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063033505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063033505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063033505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063033505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063033515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063033524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063033524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063033524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:36.414814 run osmo-msc_10.42.42.6(pid=17902): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17902)] 06:30:36.462490 run osmo-msc_10.42.42.6(pid=17902): stdout: | (launched: 2022-12-14_06:30:35.312266) 06:30:36.512106 run osmo-msc_10.42.42.6(pid=17902): stderr: | 20221214063035583 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063035583 DLGLOBAL DEBUG validating counter group 0x7f19b49a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063035584 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063035584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063035584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063035584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063035586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063035586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063035586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063035586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:36.561901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17895): Terminating (SIGTERM) 06:30:36.601747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17898): Terminating (SIGTERM) 06:30:36.641590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17901): Terminating (SIGTERM) 06:30:36.681688 --- ParallelTerminationStrategy: PID 17895 died... 06:30:36.701112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17895): Terminated: ok {rc=0} 06:30:36.745281 --- ParallelTerminationStrategy: PID 17898 died... 06:30:36.764358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17898): Terminated: ok {rc=0} 06:30:36.808296 --- ParallelTerminationStrategy: PID 17901 died... 06:30:36.827323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17901): Terminated: ok {rc=0} 06:30:36.913240 bus /sierra_3: Setting Powered False 06:30:38.012743 bus /sierra_3: Setting Powered False 06:30:39.127490 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:30:40.278592 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:40.290983 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:30:40.352089 tst mo_mt_call_osmux.py: using LAC 39050 06:30:40.481725 tst mo_mt_call_osmux.py: using RAC 35 06:30:40.612574 tst mo_mt_call_osmux.py: using CellId 39050 06:30:40.743168 tst mo_mt_call_osmux.py: using BVCI 39051 06:30:40.863317 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:40.875124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:40.886826 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:40.898446 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:40.910221 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:30:40.921821 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:30:41.040152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:30:41.162548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:41.680357 run create_hlr_db(pid=17904): Launched 06:30:41.815780 bus /sierra_2: Setting Powered False 06:30:42.881367 run create_hlr_db(pid=17904): Terminated: ok {rc=0} 06:30:43.326164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17906): Launched 06:30:43.640934 run osmo-hlr_10.42.42.2(pid=17907): Launched 06:30:43.761259 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:44.305748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17909): Launched 06:30:44.619045 run osmo-stp_10.42.42.5(pid=17910): Launched 06:30:44.738969 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:45.305740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17912): Launched 06:30:45.619670 run osmo-msc_10.42.42.6(pid=17913): Launched 06:30:45.795986 run osmo-stp_10.42.42.5(pid=17910): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17910)] 06:30:46.061110 run osmo-stp_10.42.42.5(pid=17910): stdout: | (launched: 2022-12-14_06:30:44.561439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:46.234588 run osmo-stp_10.42.42.5(pid=17910): stderr: | 20221214063044732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063044732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063044732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063044733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063044733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063044733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063044733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:46.387215 run osmo-stp_10.42.42.5(pid=17910): stdout: | (launched: 2022-12-14_06:30:44.561439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:46.523781 run osmo-stp_10.42.42.5(pid=17910): stderr: | 20221214063044732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063044732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063044732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063044733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063044733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063044733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063044733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:46.687099 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17910): Process ended prematurely: osmo-stp_10.42.42.5(pid=17910) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17910)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:30:46.698328 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:30:46.726894 run osmo-hlr_10.42.42.2(pid=17907): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17907)] 06:30:46.780066 run osmo-hlr_10.42.42.2(pid=17907): stdout: | (launched: 2022-12-14_06:30:43.582809) 06:30:46.834565 run osmo-hlr_10.42.42.2(pid=17907): stderr: | 20221214063043760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063043761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063043761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063043761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063043761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063043761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063043773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063043783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063043783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063043783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:46.909126 run osmo-msc_10.42.42.6(pid=17913): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17913)] 06:30:46.962044 run osmo-msc_10.42.42.6(pid=17913): stdout: | (launched: 2022-12-14_06:30:45.561918) 06:30:47.015609 run osmo-msc_10.42.42.6(pid=17913): stderr: | 20221214063045837 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063045837 DLGLOBAL DEBUG validating counter group 0x7ff738bc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063045837 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063045837 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063045837 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063045837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063045839 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063045840 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063045840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063045840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:47.070118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17906): Terminating (SIGTERM) 06:30:47.113824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17909): Terminating (SIGTERM) 06:30:47.160373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17912): Terminating (SIGTERM) 06:30:47.205732 --- ParallelTerminationStrategy: PID 17906 died... 06:30:47.226529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17906): Terminated: ok {rc=0} 06:30:47.275269 --- ParallelTerminationStrategy: PID 17909 died... 06:30:47.295606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17909): Terminated: ok {rc=0} 06:30:47.344411 --- ParallelTerminationStrategy: PID 17912 died... 06:30:47.364239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17912): Terminated: ok {rc=0} 06:30:47.451830 bus /sierra_3: Setting Powered False 06:30:48.550245 bus /sierra_3: Setting Powered False 06:30:49.665855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:30:50.911976 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:50.920303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:30:50.944632 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:30:50.971959 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:30:51.025237 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:30:51.049825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:30:51.077443 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:30:51.631198 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:30:51.686104 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:30:51.698082 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:30:51.760338 tst mo_mt_call.py: using LAC 39051 06:30:51.892679 tst mo_mt_call.py: using RAC 36 06:30:52.021277 tst mo_mt_call.py: using CellId 39051 06:30:52.145970 tst mo_mt_call.py: using BVCI 39052 06:30:52.258476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:30:52.269743 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:30:52.280816 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:30:52.292027 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:30:52.303429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:30:52.314734 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:30:52.434765 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:30:52.556101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:53.071352 run create_hlr_db(pid=17921): Launched 06:30:53.206154 bus /sierra_2: Setting Powered False 06:30:54.271240 run create_hlr_db(pid=17921): Terminated: ok {rc=0} 06:30:54.716862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17923): Launched 06:30:55.029551 run osmo-hlr_10.42.42.2(pid=17924): Launched 06:30:55.148119 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:55.690134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17926): Launched 06:30:56.005683 run osmo-stp_10.42.42.5(pid=17927): Launched 06:30:56.124065 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:56.689520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17929): Launched 06:30:57.001870 run osmo-msc_10.42.42.6(pid=17930): Launched 06:30:57.176683 run osmo-stp_10.42.42.5(pid=17927): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17927)] 06:30:57.309338 run osmo-stp_10.42.42.5(pid=17927): stdout: | (launched: 2022-12-14_06:30:55.948021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:57.441231 run osmo-stp_10.42.42.5(pid=17927): stderr: | 20221214063056118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063056118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063056119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063056119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063056119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063056119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063056120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:57.571254 run osmo-stp_10.42.42.5(pid=17927): stdout: | (launched: 2022-12-14_06:30:55.948021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:57.695382 run osmo-stp_10.42.42.5(pid=17927): stderr: | 20221214063056118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063056118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063056119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063056119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063056119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063056119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063056120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:57.844171 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17927): Process ended prematurely: osmo-stp_10.42.42.5(pid=17927) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17927)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:30:57.853424 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:30:57.879930 run osmo-hlr_10.42.42.2(pid=17924): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17924)] 06:30:57.927810 run osmo-hlr_10.42.42.2(pid=17924): stdout: | (launched: 2022-12-14_06:30:54.972464) 06:30:57.976916 run osmo-hlr_10.42.42.2(pid=17924): stderr: | 20221214063055149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063055149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063055149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063055149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063055149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063055150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063055165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063055175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063055175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063055175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:58.046081 run osmo-msc_10.42.42.6(pid=17930): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17930)] 06:30:58.093324 run osmo-msc_10.42.42.6(pid=17930): stdout: | (launched: 2022-12-14_06:30:56.944659) 06:30:58.142362 run osmo-msc_10.42.42.6(pid=17930): stderr: | 20221214063057216 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063057216 DLGLOBAL DEBUG validating counter group 0x7fc095a88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063057216 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063057216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063057216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063057217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063057218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063057219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063057219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063057219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:58.191695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17923): Terminating (SIGTERM) 06:30:58.231436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17926): Terminating (SIGTERM) 06:30:58.271088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17929): Terminating (SIGTERM) 06:30:58.311160 --- ParallelTerminationStrategy: PID 17923 died... 06:30:58.330565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17923): Terminated: ok {rc=0} 06:30:58.374660 --- ParallelTerminationStrategy: PID 17926 died... 06:30:58.393549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17926): Terminated: ok {rc=0} 06:30:58.437324 --- ParallelTerminationStrategy: PID 17929 died... 06:30:58.456240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17929): Terminated: ok {rc=0} 06:30:58.541980 bus /sierra_3: Setting Powered False 06:30:59.640909 bus /sierra_3: Setting Powered False 06:31:00.756341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:31:01.935807 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:31:01.952337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:31:02.025285 tst mo_mt_call_osmux.py: using LAC 39052 06:31:02.157342 tst mo_mt_call_osmux.py: using RAC 37 06:31:02.291324 tst mo_mt_call_osmux.py: using CellId 39052 06:31:02.415288 tst mo_mt_call_osmux.py: using BVCI 39053 06:31:02.529904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:31:02.541344 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:31:02.552464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:31:02.563571 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:31:02.575256 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:31:02.586674 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:31:02.704888 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:31:02.828674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:03.315009 run create_hlr_db(pid=17932): Launched 06:31:03.434000 bus /sierra_2: Setting Powered False 06:31:04.495631 run create_hlr_db(pid=17932): Terminated: ok {rc=0} 06:31:04.950738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17934): Launched 06:31:05.284507 run osmo-hlr_10.42.42.2(pid=17935): Launched 06:31:05.411563 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:05.985922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17937): Launched 06:31:06.318040 run osmo-stp_10.42.42.5(pid=17938): Launched 06:31:06.445136 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:07.050159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17940): Launched 06:31:07.382933 run osmo-msc_10.42.42.6(pid=17941): Launched 06:31:07.569905 run osmo-stp_10.42.42.5(pid=17938): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17938)] 06:31:07.709235 run osmo-stp_10.42.42.5(pid=17938): stdout: | (launched: 2022-12-14_06:31:06.257647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:07.848912 run osmo-stp_10.42.42.5(pid=17938): stderr: | 20221214063106449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063106449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063106449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063106449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063106450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063106450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063106450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:07.987653 run osmo-stp_10.42.42.5(pid=17938): stdout: | (launched: 2022-12-14_06:31:06.257647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:08.119568 run osmo-stp_10.42.42.5(pid=17938): stderr: | 20221214063106449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063106449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063106449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063106449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063106450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063106450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063106450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:08.277678 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17938): Process ended prematurely: osmo-stp_10.42.42.5(pid=17938) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17938)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:31:08.287473 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:31:08.315351 run osmo-hlr_10.42.42.2(pid=17935): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17935)] 06:31:08.365757 run osmo-hlr_10.42.42.2(pid=17935): stdout: | (launched: 2022-12-14_06:31:05.223670) 06:31:08.417375 run osmo-hlr_10.42.42.2(pid=17935): stderr: | 20221214063105422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063105422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063105422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063105422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063105422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063105422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063105448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063105457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063105457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063105457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:08.489472 run osmo-msc_10.42.42.6(pid=17941): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17941)] 06:31:08.539388 run osmo-msc_10.42.42.6(pid=17941): stdout: | (launched: 2022-12-14_06:31:07.322356) 06:31:08.591301 run osmo-msc_10.42.42.6(pid=17941): stderr: | 20221214063107646 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063107646 DLGLOBAL DEBUG validating counter group 0x7fb66d947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063107646 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063107646 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063107646 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063107646 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063107648 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063107648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063107648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063107648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:08.643364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17934): Terminating (SIGTERM) 06:31:08.685424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17937): Terminating (SIGTERM) 06:31:08.727602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17940): Terminating (SIGTERM) 06:31:08.769596 --- ParallelTerminationStrategy: PID 17934 died... 06:31:08.789676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17934): Terminated: ok {rc=0} 06:31:08.835701 --- ParallelTerminationStrategy: PID 17937 died... 06:31:08.855415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17937): Terminated: ok {rc=0} 06:31:08.901341 --- ParallelTerminationStrategy: PID 17940 died... 06:31:08.920884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17940): Terminated: ok {rc=0} 06:31:09.008865 bus /sierra_3: Setting Powered False 06:31:10.107578 bus /sierra_3: Setting Powered False 06:31:11.222888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:31:12.468278 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:31:12.476478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:31:12.501071 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:31:12.528496 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:31:12.582849 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:31:12.606910 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:31:12.634282 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:31:13.187072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:31:13.240665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:13.252681 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:31:13.313752 tst mo_mt_call.py: using LAC 39053 06:31:13.443574 tst mo_mt_call.py: using RAC 38 06:31:13.574383 tst mo_mt_call.py: using CellId 39053 06:31:13.705027 tst mo_mt_call.py: using BVCI 39054 06:31:13.825625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:13.837361 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:13.848791 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:13.860295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:13.872286 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:13.883812 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:31:14.001386 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:31:14.119675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:14.635697 run create_hlr_db(pid=17946): Launched 06:31:14.770487 bus /sierra_2: Setting Powered False 06:31:15.837282 run create_hlr_db(pid=17946): Terminated: ok {rc=0} 06:31:16.310028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17948): Launched 06:31:16.665680 run osmo-hlr_10.42.42.2(pid=17949): Launched 06:31:16.813664 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:17.557902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17951): Launched 06:31:17.890834 run osmo-stp_10.42.42.5(pid=17952): Launched 06:31:18.018428 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:18.619807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17954): Launched 06:31:18.952529 run osmo-msc_10.42.42.6(pid=17955): Launched 06:31:19.137778 run osmo-stp_10.42.42.5(pid=17952): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17952)] 06:31:19.277676 run osmo-stp_10.42.42.5(pid=17952): stdout: | (launched: 2022-12-14_06:31:17.829702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:19.417893 run osmo-stp_10.42.42.5(pid=17952): stderr: | 20221214063118025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063118025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063118025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063118026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063118026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063118026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063118026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:19.555894 run osmo-stp_10.42.42.5(pid=17952): stdout: | (launched: 2022-12-14_06:31:17.829702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:19.687978 run osmo-stp_10.42.42.5(pid=17952): stderr: | 20221214063118025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063118025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063118025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063118026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063118026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063118026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063118026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:19.846027 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17952): Process ended prematurely: osmo-stp_10.42.42.5(pid=17952) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17952)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:31:19.855696 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 06:31:19.883690 run osmo-hlr_10.42.42.2(pid=17949): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17949)] 06:31:19.933765 run osmo-hlr_10.42.42.2(pid=17949): stdout: | (launched: 2022-12-14_06:31:16.597240) 06:31:19.985620 run osmo-hlr_10.42.42.2(pid=17949): stderr: | 20221214063116960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063116965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063116965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063116965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063116965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063116965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063116979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063116991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063116991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063116991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:20.058833 run osmo-msc_10.42.42.6(pid=17955): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17955)] 06:31:20.108839 run osmo-msc_10.42.42.6(pid=17955): stdout: | (launched: 2022-12-14_06:31:18.891814) 06:31:20.160561 run osmo-msc_10.42.42.6(pid=17955): stderr: | 20221214063119214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063119214 DLGLOBAL DEBUG validating counter group 0x7f710214bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063119214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063119215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063119215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063119215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063119217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063119217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063119217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063119217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:20.212659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17948): Terminating (SIGTERM) 06:31:20.254222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17951): Terminating (SIGTERM) 06:31:20.296547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17954): Terminating (SIGTERM) 06:31:20.339249 --- ParallelTerminationStrategy: PID 17948 died... 06:31:20.359320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17948): Terminated: ok {rc=0} 06:31:20.405508 --- ParallelTerminationStrategy: PID 17951 died... 06:31:20.424899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17951): Terminated: ok {rc=0} 06:31:20.471177 --- ParallelTerminationStrategy: PID 17954 died... 06:31:20.490742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17954): Terminated: ok {rc=0} 06:31:20.578402 bus /sierra_3: Setting Powered False 06:31:21.677224 bus /sierra_3: Setting Powered False 06:31:22.793850 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:31:23.941432 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:23.953612 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:31:24.013613 tst mo_mt_call_osmux.py: using LAC 39054 06:31:24.145871 tst mo_mt_call_osmux.py: using RAC 39 06:31:24.275978 tst mo_mt_call_osmux.py: using CellId 39054 06:31:24.407162 tst mo_mt_call_osmux.py: using BVCI 39055 06:31:24.529512 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:24.541389 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:24.553033 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:24.564809 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:24.576404 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:31:24.587948 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:31:24.705077 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:31:24.826685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:25.342260 run create_hlr_db(pid=17957): Launched 06:31:25.475641 bus /sierra_2: Setting Powered False 06:31:26.542133 run create_hlr_db(pid=17957): Terminated: ok {rc=0} 06:31:27.004453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17959): Launched 06:31:27.337193 run osmo-hlr_10.42.42.2(pid=17960): Launched 06:31:27.463016 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:28.035468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17962): Launched 06:31:28.371302 run osmo-stp_10.42.42.5(pid=17963): Launched 06:31:28.497545 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:29.107384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17965): Launched 06:31:29.442457 run osmo-msc_10.42.42.6(pid=17966): Launched 06:31:29.629364 run osmo-stp_10.42.42.5(pid=17963): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17963)] 06:31:29.769477 run osmo-stp_10.42.42.5(pid=17963): stdout: | (launched: 2022-12-14_06:31:28.310270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:29.909709 run osmo-stp_10.42.42.5(pid=17963): stderr: | 20221214063128502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063128502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063128503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063128503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063128504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063128504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063128504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:30.048116 run osmo-stp_10.42.42.5(pid=17963): stdout: | (launched: 2022-12-14_06:31:28.310270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:30.181211 run osmo-stp_10.42.42.5(pid=17963): stderr: | 20221214063128502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063128502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063128503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063128503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063128504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063128504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063128504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:30.339697 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17963): Process ended prematurely: osmo-stp_10.42.42.5(pid=17963) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17963)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:31:30.349564 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:31:30.377488 run osmo-hlr_10.42.42.2(pid=17960): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17960)] 06:31:30.427448 run osmo-hlr_10.42.42.2(pid=17960): stdout: | (launched: 2022-12-14_06:31:27.276298) 06:31:30.479360 run osmo-hlr_10.42.42.2(pid=17960): stderr: | 20221214063127477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063127477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063127477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063127477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063127477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063127478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063127490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063127498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063127498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063127498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:30.551651 run osmo-msc_10.42.42.6(pid=17966): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17966)] 06:31:30.601844 run osmo-msc_10.42.42.6(pid=17966): stdout: | (launched: 2022-12-14_06:31:29.381726) 06:31:30.653493 run osmo-msc_10.42.42.6(pid=17966): stderr: | 20221214063129704 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063129704 DLGLOBAL DEBUG validating counter group 0x7fd3512fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063129704 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063129704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063129705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063129705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063129707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063129707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063129707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063129707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:30.705787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17959): Terminating (SIGTERM) 06:31:30.747475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17962): Terminating (SIGTERM) 06:31:30.789142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17965): Terminating (SIGTERM) 06:31:30.831267 --- ParallelTerminationStrategy: PID 17959 died... 06:31:30.852495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17959): Terminated: ok {rc=0} 06:31:30.899511 --- ParallelTerminationStrategy: PID 17962 died... 06:31:30.919893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17962): Terminated: ok {rc=0} 06:31:30.967037 --- ParallelTerminationStrategy: PID 17965 died... 06:31:30.987398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17965): Terminated: ok {rc=0} 06:31:31.077369 bus /sierra_3: Setting Powered False 06:31:32.191237 bus /sierra_3: Setting Powered False 06:31:33.322533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:31:34.564209 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:31:34.573836 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:31:34.598941 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:31:34.627298 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:31:34.682276 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:31:34.707400 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:31:34.735233 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:31:35.287028 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:31:35.340896 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:35.352735 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:31:35.414743 tst mo_mt_call.py: using LAC 39055 06:31:35.545629 tst mo_mt_call.py: using RAC 40 06:31:35.676617 tst mo_mt_call.py: using CellId 39055 06:31:35.805576 tst mo_mt_call.py: using BVCI 39056 06:31:35.926887 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:35.938748 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:35.950336 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:35.962105 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:35.973784 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:35.985375 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:31:36.103016 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:31:36.223533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:36.739631 run create_hlr_db(pid=17971): Launched 06:31:36.873915 bus /sierra_2: Setting Powered False 06:31:37.939373 run create_hlr_db(pid=17971): Terminated: ok {rc=0} 06:31:38.402767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17973): Launched 06:31:38.736150 run osmo-hlr_10.42.42.2(pid=17974): Launched 06:31:38.862259 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:39.434250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17976): Launched 06:31:39.767111 run osmo-stp_10.42.42.5(pid=17977): Launched 06:31:39.893756 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:40.496034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17979): Launched 06:31:40.829185 run osmo-msc_10.42.42.6(pid=17980): Launched 06:31:41.013694 run osmo-stp_10.42.42.5(pid=17977): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17977)] 06:31:41.153360 run osmo-stp_10.42.42.5(pid=17977): stdout: | (launched: 2022-12-14_06:31:39.706677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:41.293191 run osmo-stp_10.42.42.5(pid=17977): stderr: | 20221214063139899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063139899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063139899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063139900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063139900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063139900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063139900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:41.432363 run osmo-stp_10.42.42.5(pid=17977): stdout: | (launched: 2022-12-14_06:31:39.706677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:41.565043 run osmo-stp_10.42.42.5(pid=17977): stderr: | 20221214063139899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063139899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063139899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063139900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063139900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063139900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063139900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:41.723967 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17977): Process ended prematurely: osmo-stp_10.42.42.5(pid=17977) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17977)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:31:41.733822 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:31:41.761856 run osmo-hlr_10.42.42.2(pid=17974): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17974)] 06:31:41.811747 run osmo-hlr_10.42.42.2(pid=17974): stdout: | (launched: 2022-12-14_06:31:38.675401) 06:31:41.863520 run osmo-hlr_10.42.42.2(pid=17974): stderr: | 20221214063138876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063138876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063138876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063138876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063138876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063138876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063138888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063138897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063138898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063138898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:41.935779 run osmo-msc_10.42.42.6(pid=17980): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17980)] 06:31:41.985684 run osmo-msc_10.42.42.6(pid=17980): stdout: | (launched: 2022-12-14_06:31:40.768587) 06:31:42.037190 run osmo-msc_10.42.42.6(pid=17980): stderr: | 20221214063141092 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063141093 DLGLOBAL DEBUG validating counter group 0x7faece56bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063141093 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063141093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063141093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063141093 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063141095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063141095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063141095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063141095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:42.089286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17973): Terminating (SIGTERM) 06:31:42.131048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17976): Terminating (SIGTERM) 06:31:42.173220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17979): Terminating (SIGTERM) 06:31:42.215925 --- ParallelTerminationStrategy: PID 17973 died... 06:31:42.236416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17973): Terminated: ok {rc=0} 06:31:42.282651 --- ParallelTerminationStrategy: PID 17976 died... 06:31:42.302249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17976): Terminated: ok {rc=0} 06:31:42.348464 --- ParallelTerminationStrategy: PID 17979 died... 06:31:42.368228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17979): Terminated: ok {rc=0} 06:31:42.456581 bus /sierra_3: Setting Powered False 06:31:43.555382 bus /sierra_3: Setting Powered False 06:31:44.671398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:31:45.817453 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:45.832891 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:31:45.894922 tst mo_mt_call_osmux.py: using LAC 39056 06:31:46.034210 tst mo_mt_call_osmux.py: using RAC 41 06:31:46.178281 tst mo_mt_call_osmux.py: using CellId 39056 06:31:46.312422 tst mo_mt_call_osmux.py: using BVCI 39057 06:31:46.436660 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:46.449689 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:46.462444 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:46.475034 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:46.487954 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:31:46.500342 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:31:46.638328 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:31:46.762354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:47.293584 run create_hlr_db(pid=17982): Launched 06:31:47.417731 bus /sierra_2: Setting Powered False 06:31:48.480231 run create_hlr_db(pid=17982): Terminated: ok {rc=0} 06:31:48.935827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17984): Launched 06:31:49.268762 run osmo-hlr_10.42.42.2(pid=17985): Launched 06:31:49.395891 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:49.970133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17987): Launched 06:31:50.304616 run osmo-stp_10.42.42.5(pid=17988): Launched 06:31:50.432523 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:51.036028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17990): Launched 06:31:51.369564 run osmo-msc_10.42.42.6(pid=17991): Launched 06:31:51.554166 run osmo-stp_10.42.42.5(pid=17988): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17988)] 06:31:51.693605 run osmo-stp_10.42.42.5(pid=17988): stdout: | (launched: 2022-12-14_06:31:50.243218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:51.833390 run osmo-stp_10.42.42.5(pid=17988): stderr: | 20221214063150439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063150439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063150439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063150440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063150440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063150440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063150440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:51.971919 run osmo-stp_10.42.42.5(pid=17988): stdout: | (launched: 2022-12-14_06:31:50.243218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:52.104155 run osmo-stp_10.42.42.5(pid=17988): stderr: | 20221214063150439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063150439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063150439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063150440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063150440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063150440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063150440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:52.261985 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17988): Process ended prematurely: osmo-stp_10.42.42.5(pid=17988) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17988)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:31:52.272046 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:31:52.300636 run osmo-hlr_10.42.42.2(pid=17985): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17985)] 06:31:52.351375 run osmo-hlr_10.42.42.2(pid=17985): stdout: | (launched: 2022-12-14_06:31:49.208174) 06:31:52.403386 run osmo-hlr_10.42.42.2(pid=17985): stderr: | 20221214063149409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063149409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063149409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063149409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063149409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063149409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063149422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063149430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063149430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063149430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:52.475921 run osmo-msc_10.42.42.6(pid=17991): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17991)] 06:31:52.525924 run osmo-msc_10.42.42.6(pid=17991): stdout: | (launched: 2022-12-14_06:31:51.308395) 06:31:52.577916 run osmo-msc_10.42.42.6(pid=17991): stderr: | 20221214063151630 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063151630 DLGLOBAL DEBUG validating counter group 0x7f154debec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063151630 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063151630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063151630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063151631 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063151632 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063151633 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063151633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063151633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:52.630078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17984): Terminating (SIGTERM) 06:31:52.672035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17987): Terminating (SIGTERM) 06:31:52.714023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17990): Terminating (SIGTERM) 06:31:52.756451 --- ParallelTerminationStrategy: PID 17984 died... 06:31:52.776724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17984): Terminated: ok {rc=0} 06:31:52.823215 --- ParallelTerminationStrategy: PID 17987 died... 06:31:52.843112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17987): Terminated: ok {rc=0} 06:31:52.889275 --- ParallelTerminationStrategy: PID 17990 died... 06:31:52.908913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17990): Terminated: ok {rc=0} 06:31:52.996578 bus /sierra_3: Setting Powered False 06:31:54.095110 bus /sierra_3: Setting Powered False 06:31:55.209879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:31:56.454707 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:31:56.463433 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:31:56.486902 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:31:56.514129 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:31:56.566681 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:31:56.592161 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:31:56.620426 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:31:57.168695 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:31:57.220084 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:31:57.231499 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:31:57.292013 tst mo_mt_call.py: using LAC 39057 06:31:57.414293 tst mo_mt_call.py: using RAC 42 06:31:57.538692 tst mo_mt_call.py: using CellId 39057 06:31:57.662396 tst mo_mt_call.py: using BVCI 39058 06:31:57.777231 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:31:57.788414 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:31:57.799715 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:31:57.811008 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:31:57.822780 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:31:57.834398 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:31:57.951028 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:31:58.073296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:58.590108 run create_hlr_db(pid=17996): Launched 06:31:58.725119 bus /sierra_2: Setting Powered False 06:31:59.786668 run create_hlr_db(pid=17996): Terminated: ok {rc=0} 06:32:00.250713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17998): Launched 06:32:00.585675 run osmo-hlr_10.42.42.2(pid=17999): Launched 06:32:00.711732 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:01.323902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18001): Launched 06:32:01.673543 run osmo-stp_10.42.42.5(pid=18002): Launched 06:32:01.841899 run osmo-msc_10.42.42.6: Starting osmo-msc 06:32:02.559317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18004): Launched 06:32:02.892941 run osmo-msc_10.42.42.6(pid=18005): Launched 06:32:03.077517 run osmo-stp_10.42.42.5(pid=18002): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18002)] 06:32:03.216482 run osmo-stp_10.42.42.5(pid=18002): stdout: | (launched: 2022-12-14_06:32:01.610117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:03.355804 run osmo-stp_10.42.42.5(pid=18002): stderr: | 20221214063201991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063201991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063201992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063201992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063201997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063201997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063201997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:03.494874 run osmo-stp_10.42.42.5(pid=18002): stdout: | (launched: 2022-12-14_06:32:01.610117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:03.627147 run osmo-stp_10.42.42.5(pid=18002): stderr: | 20221214063201991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063201991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063201992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063201992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063201997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063201997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063201997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:03.785691 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18002): Process ended prematurely: osmo-stp_10.42.42.5(pid=18002) [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18002)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:32:03.795657 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 06:32:03.823766 run osmo-hlr_10.42.42.2(pid=17999): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17999)] 06:32:03.874158 run osmo-hlr_10.42.42.2(pid=17999): stdout: | (launched: 2022-12-14_06:32:00.524478) 06:32:03.926561 run osmo-hlr_10.42.42.2(pid=17999): stderr: | 20221214063200723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063200723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063200723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063200723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063200724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063200724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063200736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063200746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063200747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063200747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:03.999474 run osmo-msc_10.42.42.6(pid=18005): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18005)] 06:32:04.049907 run osmo-msc_10.42.42.6(pid=18005): stdout: | (launched: 2022-12-14_06:32:02.832207) 06:32:04.101911 run osmo-msc_10.42.42.6(pid=18005): stderr: | 20221214063203159 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063203159 DLGLOBAL DEBUG validating counter group 0x7fce5fe65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063203159 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063203159 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063203159 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063203159 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063203161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063203163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063203163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063203163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:32:04.154053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17998): Terminating (SIGTERM) 06:32:04.196237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18001): Terminating (SIGTERM) 06:32:04.238212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18004): Terminating (SIGTERM) 06:32:04.280353 --- ParallelTerminationStrategy: PID 17998 died... 06:32:04.300260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17998): Terminated: ok {rc=0} 06:32:04.346812 --- ParallelTerminationStrategy: PID 18001 died... 06:32:04.366689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18001): Terminated: ok {rc=0} 06:32:04.412915 --- ParallelTerminationStrategy: PID 18004 died... 06:32:04.432708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18004): Terminated: ok {rc=0} 06:32:04.520502 bus /sierra_3: Setting Powered False 06:32:05.621154 bus /sierra_3: Setting Powered False 06:32:06.737150 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:32:07.889163 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:32:07.901910 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:32:07.966578 tst mo_mt_call_osmux.py: using LAC 39058 06:32:08.098010 tst mo_mt_call_osmux.py: using RAC 43 06:32:08.229355 tst mo_mt_call_osmux.py: using CellId 39058 06:32:08.360093 tst mo_mt_call_osmux.py: using BVCI 39059 06:32:08.482799 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:32:08.494601 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:32:08.506175 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:32:08.517728 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:32:08.529704 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:32:08.541438 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:32:08.661903 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:32:08.780521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:09.266545 run create_hlr_db(pid=18007): Launched 06:32:09.404898 bus /sierra_2: Setting Powered False 06:32:10.471001 run create_hlr_db(pid=18007): Terminated: ok {rc=0} 06:32:10.935197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18009): Launched 06:32:11.269242 run osmo-hlr_10.42.42.2(pid=18010): Launched 06:32:11.395569 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:11.973470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18012): Launched 06:32:12.306748 run osmo-stp_10.42.42.5(pid=18013): Launched 06:32:12.435135 run osmo-msc_10.42.42.6: Starting osmo-msc 06:32:13.040091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18015): Launched 06:32:13.374224 run osmo-msc_10.42.42.6(pid=18016): Launched 06:32:13.560588 run osmo-stp_10.42.42.5(pid=18013): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18013)] 06:32:13.700760 run osmo-stp_10.42.42.5(pid=18013): stdout: | (launched: 2022-12-14_06:32:12.246216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:13.840567 run osmo-stp_10.42.42.5(pid=18013): stderr: | 20221214063212441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063212441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063212441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063212442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063212442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063212442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063212442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:13.979754 run osmo-stp_10.42.42.5(pid=18013): stdout: | (launched: 2022-12-14_06:32:12.246216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:14.112411 run osmo-stp_10.42.42.5(pid=18013): stderr: | 20221214063212441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063212441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063212441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063212442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063212442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063212442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063212442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:14.271589 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18013): Process ended prematurely: osmo-stp_10.42.42.5(pid=18013) [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18013)] [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:32:14.281443 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:32:14.309539 run osmo-hlr_10.42.42.2(pid=18010): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18010)] 06:32:14.359905 run osmo-hlr_10.42.42.2(pid=18010): stdout: | (launched: 2022-12-14_06:32:11.208437) 06:32:14.412489 run osmo-hlr_10.42.42.2(pid=18010): stderr: | 20221214063211409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063211409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063211409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063211409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063211409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063211409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063211422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063211430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063211430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063211430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:14.485473 run osmo-msc_10.42.42.6(pid=18016): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18016)] 06:32:14.535627 run osmo-msc_10.42.42.6(pid=18016): stdout: | (launched: 2022-12-14_06:32:13.313348) 06:32:14.587401 run osmo-msc_10.42.42.6(pid=18016): stderr: | 20221214063213635 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063213635 DLGLOBAL DEBUG validating counter group 0x7f9fa1914c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063213635 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063213636 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063213636 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063213636 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063213638 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063213638 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063213638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063213638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:32:14.639472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18009): Terminating (SIGTERM) 06:32:14.681575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18012): Terminating (SIGTERM) 06:32:14.723763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18015): Terminating (SIGTERM) 06:32:14.766175 --- ParallelTerminationStrategy: PID 18009 died... 06:32:14.786561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18009): Terminated: ok {rc=0} 06:32:14.833156 --- ParallelTerminationStrategy: PID 18012 died... 06:32:14.853180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18012): Terminated: ok {rc=0} 06:32:14.900058 --- ParallelTerminationStrategy: PID 18015 died... 06:32:14.920103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18015): Terminated: ok {rc=0} 06:32:15.007265 bus /sierra_3: Setting Powered False 06:32:16.101959 bus /sierra_3: Setting Powered False 06:32:17.219886 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:nanobts+band-1900 --------------------------------------------------------------------- 06:32:18.458607 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:32:18.464099 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:32:18.487864 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:32:18.515625 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 06:32:18.600131 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:32:18.623722 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:32:18.650292 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 06:32:19.235305 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 06:32:19.240687 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:19.251721 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:32:19.290769 tst emergency_mo_mt_call.py: using LAC 39059 06:32:19.411433 tst emergency_mo_mt_call.py: using RAC 44 06:32:19.533392 tst emergency_mo_mt_call.py: using CellId 39059 06:32:19.656836 tst emergency_mo_mt_call.py: using BVCI 39060 06:32:19.770151 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:19.780920 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:19.791764 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:19.802533 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:19.813610 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:19.824573 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:19.945219 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:20.062736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:20.539848 run create_hlr_db(pid=18021): Launched 06:32:20.656299 bus /sierra_2: Setting Powered False 06:32:21.718017 run create_hlr_db(pid=18021): Terminated: ok {rc=0} 06:32:22.146446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18023): Launched 06:32:22.454036 run osmo-hlr_10.42.42.2(pid=18024): Launched 06:32:22.571581 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:23.118913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18026): Launched 06:32:23.426052 run osmo-stp_10.42.42.5(pid=18027): Launched 06:32:23.554984 tst emergency_mo_mt_call.py: using MSISDN 8539 06:32:23.722480 run osmo-msc_10.42.42.6: Starting osmo-msc 06:32:24.275567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18029): Launched 06:32:24.584139 run osmo-msc_10.42.42.6(pid=18030): Launched 06:32:24.756499 run osmo-stp_10.42.42.5(pid=18027): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18027)] 06:32:24.886704 run osmo-stp_10.42.42.5(pid=18027): stdout: | (launched: 2022-12-14_06:32:23.369291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:25.016364 run osmo-stp_10.42.42.5(pid=18027): stderr: | 20221214063223539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063223539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063223540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063223540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063223540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063223541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063223541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:25.144413 run osmo-stp_10.42.42.5(pid=18027): stdout: | (launched: 2022-12-14_06:32:23.369291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:25.266449 run osmo-stp_10.42.42.5(pid=18027): stderr: | 20221214063223539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063223539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063223540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063223540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063223540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063223541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063223541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:25.412225 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18027): Process ended prematurely: osmo-stp_10.42.42.5(pid=18027) [trial-2400↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18027)] [trial-2400↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 06:32:25.420937 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 06:32:25.447013 run osmo-hlr_10.42.42.2(pid=18024): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18024)] 06:32:25.495342 run osmo-hlr_10.42.42.2(pid=18024): stdout: | (launched: 2022-12-14_06:32:22.397091) 06:32:25.545068 run osmo-hlr_10.42.42.2(pid=18024): stderr: | 20221214063222574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063222574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063222574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063222574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063222574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063222574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063222587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063222595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063222595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063222596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:25.614539 run osmo-msc_10.42.42.6(pid=18030): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18030)] 06:32:25.662079 run osmo-msc_10.42.42.6(pid=18030): stdout: | (launched: 2022-12-14_06:32:24.526539) 06:32:25.711782 run osmo-msc_10.42.42.6(pid=18030): stderr: | 20221214063224798 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063224799 DLGLOBAL DEBUG validating counter group 0x7f7bea740c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063224799 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063224799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063224799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063224799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063224801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063224801 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063224802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063224802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:32:25.761668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18023): Terminating (SIGTERM) 06:32:25.802039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18026): Terminating (SIGTERM) 06:32:25.842305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18029): Terminating (SIGTERM) 06:32:25.882838 --- ParallelTerminationStrategy: PID 18023 died... 06:32:25.902669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18023): Terminated: ok {rc=0} 06:32:25.947165 --- ParallelTerminationStrategy: PID 18026 died... 06:32:25.966331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18026): Terminated: ok {rc=0} 06:32:26.010545 --- ParallelTerminationStrategy: PID 18029 died... 06:32:26.029857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18029): Terminated: ok {rc=0} 06:32:26.116363 bus /sierra_3: Setting Powered False 06:32:27.216088 bus /sierra_3: Setting Powered False 06:32:28.332166 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 06:32:29.420282 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:29.432555 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:32:29.475441 tst emergency_preemptive_call.py: using LAC 39060 06:32:29.597202 tst emergency_preemptive_call.py: using RAC 45 06:32:29.718383 tst emergency_preemptive_call.py: using CellId 39060 06:32:29.842736 tst emergency_preemptive_call.py: using BVCI 39061 06:32:29.955302 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:29.966326 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:29.977300 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:29.987790 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:29.998724 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:32:30.009700 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:30.124359 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:30.242535 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:30.357203 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:30.472532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:30.973741 run create_hlr_db(pid=18032): Launched 06:32:31.171526 bus /sierra_2: Setting Powered False 06:32:32.235481 run create_hlr_db(pid=18032): Terminated: ok {rc=0} 06:32:32.695657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18034): Launched 06:32:33.025266 run osmo-hlr_10.42.42.2(pid=18035): Launched 06:32:33.152098 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:33.717533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18037): Launched 06:32:34.045237 run osmo-stp_10.42.42.5(pid=18038): Launched 06:32:34.181835 tst emergency_preemptive_call.py: using MSISDN 8540 06:32:34.351413 run osmo-msc_10.42.42.6: Starting osmo-msc 06:32:34.941868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18040): Launched 06:32:35.270235 run osmo-msc_10.42.42.6(pid=18041): Launched 06:32:35.457706 run osmo-stp_10.42.42.5(pid=18038): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18038)] 06:32:35.595473 run osmo-stp_10.42.42.5(pid=18038): stdout: | (launched: 2022-12-14_06:32:33.985594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:35.733976 run osmo-stp_10.42.42.5(pid=18038): stderr: | 20221214063234180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063234180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063234180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063234181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063234181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063234181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063234181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:35.871143 run osmo-stp_10.42.42.5(pid=18038): stdout: | (launched: 2022-12-14_06:32:33.985594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:36.001701 run osmo-stp_10.42.42.5(pid=18038): stderr: | 20221214063234180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063234180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063234180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063234181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063234181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063234181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063234181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:36.157741 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18038): Process ended prematurely: osmo-stp_10.42.42.5(pid=18038) [trial-2400↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18038)] [trial-2400↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 06:32:36.166826 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 06:32:36.194373 run osmo-hlr_10.42.42.2(pid=18035): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18035)] 06:32:36.244483 run osmo-hlr_10.42.42.2(pid=18035): stdout: | (launched: 2022-12-14_06:32:32.965223) 06:32:36.296614 run osmo-hlr_10.42.42.2(pid=18035): stderr: | 20221214063233164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063233164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063233164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063233164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063233164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063233164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063233177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063233185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063233185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063233185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:36.369411 run osmo-msc_10.42.42.6(pid=18041): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18041)] 06:32:36.419500 run osmo-msc_10.42.42.6(pid=18041): stdout: | (launched: 2022-12-14_06:32:35.210185) 06:32:36.471377 run osmo-msc_10.42.42.6(pid=18041): stderr: | 20221214063235533 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063235533 DLGLOBAL DEBUG validating counter group 0x7f09e04d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063235533 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063235533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063235534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063235534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063235535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063235536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063235536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063235536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:32:36.523726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18034): Terminating (SIGTERM) 06:32:36.565552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18037): Terminating (SIGTERM) 06:32:36.607983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18040): Terminating (SIGTERM) 06:32:36.650719 --- ParallelTerminationStrategy: PID 18034 died... 06:32:36.670972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18034): Terminated: ok {rc=0} 06:32:36.717472 --- ParallelTerminationStrategy: PID 18037 died... 06:32:36.737076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18037): Terminated: ok {rc=0} 06:32:36.783150 --- ParallelTerminationStrategy: PID 18040 died... 06:32:36.802813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18040): Terminated: ok {rc=0} 06:32:36.890845 bus /sierra_9: Setting Powered False 06:32:37.989758 bus /sierra_9: Setting Powered False 06:32:39.105488 bus /sierra_8: Setting Powered False 06:32:40.201846 bus /sierra_8: Setting Powered False 06:32:41.317188 bus /sierra_3: Setting Powered False 06:32:42.415727 bus /sierra_3: Setting Powered False 06:32:43.529277 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-1900 --------------------------------------------------------------------- 06:32:44.800804 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:32:44.806219 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:32:44.829436 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 06:32:44.868304 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 06:32:44.954616 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:32:44.977894 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 06:32:45.015877 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 06:32:45.606765 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 06:32:45.658830 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:45.669657 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:32:45.707924 tst cs_paging_gprs_active.py: using LAC 39061 06:32:45.843218 tst cs_paging_gprs_active.py: using RAC 46 06:32:45.986428 tst cs_paging_gprs_active.py: using CellId 39061 06:32:46.119031 tst cs_paging_gprs_active.py: using BVCI 39062 06:32:46.238199 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.250145 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.261910 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.273621 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.286716 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.299583 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.312600 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.325145 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:46.337970 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:46.463602 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:46.605149 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:32:46.875151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:47.232060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18046): Launched 06:32:47.513573 run iperf3-srv_10.42.42.10(pid=18047): Launched 06:32:47.631382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:32:47.843419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:48.159215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18048): Launched 06:32:48.432821 run iperf3-srv_10.42.42.10(pid=18049): Launched 06:32:48.551148 tst cs_paging_gprs_active.py:38: start network... 06:32:48.762973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:49.249200 run create_hlr_db(pid=18050): Launched 06:32:49.368182 bus /sierra_2: Setting Powered False 06:32:50.429364 run create_hlr_db(pid=18050): Terminated: ok {rc=0} 06:32:50.886792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18052): Launched 06:32:51.221293 run osmo-hlr_10.42.42.2(pid=18053): Launched 06:32:51.348118 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:51.928582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18055): Launched 06:32:52.262732 run osmo-stp_10.42.42.5(pid=18056): Launched 06:32:52.390770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:52.966723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18058): Launched 06:32:53.094517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:53.377242 run patchelf(pid=18059): Launched 06:32:53.562800 run osmo-stp_10.42.42.5(pid=18056): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18056)] 06:32:53.704308 run osmo-stp_10.42.42.5(pid=18056): stdout: | (launched: 2022-12-14_06:32:52.201778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:53.847094 run osmo-stp_10.42.42.5(pid=18056): stderr: | 20221214063252396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063252396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063252396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063252397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063252397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063252397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063252397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:53.989918 run osmo-stp_10.42.42.5(pid=18056): stdout: | (launched: 2022-12-14_06:32:52.201778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:54.126188 run osmo-stp_10.42.42.5(pid=18056): stderr: | 20221214063252396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063252396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063252396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063252397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063252397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063252397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063252397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:54.287742 run patchelf(pid=18059): Terminating (SIGINT) 06:32:54.474867 run patchelf(pid=18059): Terminated: ok {rc=0} 06:32:54.609433 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18056): Process ended prematurely: osmo-stp_10.42.42.5(pid=18056) [trial-2400↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18056)] [trial-2400↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 06:32:54.619695 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 06:32:54.648492 run osmo-hlr_10.42.42.2(pid=18053): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18053)] 06:32:54.698243 run osmo-hlr_10.42.42.2(pid=18053): stdout: | (launched: 2022-12-14_06:32:51.160094) 06:32:54.750143 run osmo-hlr_10.42.42.2(pid=18053): stderr: | 20221214063251360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063251360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063251360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063251360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063251360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063251360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063251377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063251385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063251385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063251386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:54.802805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18046): Terminating (SIGTERM) 06:32:54.844658 run iperf3-srv_10.42.42.10(pid=18047): Terminating (SIGTERM) 06:32:54.886841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18048): Terminating (SIGTERM) 06:32:54.928899 run iperf3-srv_10.42.42.10(pid=18049): Terminating (SIGTERM) 06:32:54.971019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18052): Terminating (SIGTERM) 06:32:55.012935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18055): Terminating (SIGTERM) 06:32:55.054470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18058): Terminating (SIGTERM) 06:32:55.096879 --- ParallelTerminationStrategy: PID 18046 died... 06:32:55.116994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18046): Terminated: ok {rc=0} 06:32:55.163363 --- ParallelTerminationStrategy: PID 18047 died... 06:32:55.183313 run iperf3-srv_10.42.42.10(pid=18047): Terminated {rc=256} 06:32:55.229302 --- ParallelTerminationStrategy: PID 18048 died... 06:32:55.248630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18048): Terminated: ok {rc=0} 06:32:55.294863 --- ParallelTerminationStrategy: PID 18049 died... 06:32:55.314355 run iperf3-srv_10.42.42.10(pid=18049): Terminated {rc=256} 06:32:55.360050 --- ParallelTerminationStrategy: PID 18052 died... 06:32:55.379517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18052): Terminated: ok {rc=0} 06:32:55.425555 --- ParallelTerminationStrategy: PID 18055 died... 06:32:55.445040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18055): Terminated: ok {rc=0} 06:32:55.491154 --- ParallelTerminationStrategy: PID 18058 died... 06:32:55.511016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18058): Terminated: ok {rc=0} 06:32:55.599949 bus /gobi_0: Setting Powered False 06:32:56.698963 bus /gobi_0: Setting Powered False 06:32:57.816452 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 06:32:58.965856 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:58.977552 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:32:59.017079 tst iperf3.py: using LAC 39062 06:32:59.147904 tst iperf3.py: using RAC 47 06:32:59.280911 tst iperf3.py: using CellId 39062 06:32:59.411019 tst iperf3.py: using BVCI 39063 06:32:59.531761 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.543148 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.554371 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.565556 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.576560 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.587669 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.599066 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.610200 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:59.621478 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:59.746993 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:32:59.972504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:00.307683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18061): Launched 06:33:00.599909 run iperf3-srv_10.42.42.10(pid=18062): Launched 06:33:00.724760 tst iperf3.py:8: start network... 06:33:00.964618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:01.493133 run create_hlr_db(pid=18064): Launched 06:33:01.696440 bus /gobi_6: Setting Powered False 06:33:02.758716 run create_hlr_db(pid=18064): Terminated: ok {rc=0} 06:33:03.257189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18066): Launched 06:33:03.591193 run osmo-hlr_10.42.42.2(pid=18067): Launched 06:33:03.719766 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:04.293455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18069): Launched 06:33:04.626270 run osmo-stp_10.42.42.5(pid=18070): Launched 06:33:04.755410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:05.333509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18072): Launched 06:33:05.461940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:05.744864 run patchelf(pid=18073): Launched 06:33:05.929791 run osmo-stp_10.42.42.5(pid=18070): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18070)] 06:33:06.070285 run osmo-stp_10.42.42.5(pid=18070): stdout: | (launched: 2022-12-14_06:33:04.565438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:06.213169 run osmo-stp_10.42.42.5(pid=18070): stderr: | 20221214063304758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063304758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063304758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063304759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063304759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063304759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063304759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:06.355852 run osmo-stp_10.42.42.5(pid=18070): stdout: | (launched: 2022-12-14_06:33:04.565438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:06.492221 run osmo-stp_10.42.42.5(pid=18070): stderr: | 20221214063304758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063304758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063304758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063304759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063304759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063304759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063304759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:06.653335 run patchelf(pid=18073): Terminating (SIGINT) 06:33:06.839930 run patchelf(pid=18073): Terminated: ok {rc=0} 06:33:06.974806 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18070): Process ended prematurely: osmo-stp_10.42.42.5(pid=18070) [trial-2400↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18070)] [trial-2400↪gprs:nanobts+band-1900↪iperf3.py:8] 06:33:06.985117 tst iperf3.py:8: Test FAILED (8.1 sec) 06:33:07.013678 run osmo-hlr_10.42.42.2(pid=18067): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18067)] 06:33:07.063687 run osmo-hlr_10.42.42.2(pid=18067): stdout: | (launched: 2022-12-14_06:33:03.530432) 06:33:07.115691 run osmo-hlr_10.42.42.2(pid=18067): stderr: | 20221214063303729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063303729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063303729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063303729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063303729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063303729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063303741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063303750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063303750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063303750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:07.168112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18061): Terminating (SIGTERM) 06:33:07.210363 run iperf3-srv_10.42.42.10(pid=18062): Terminating (SIGTERM) 06:33:07.252754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18066): Terminating (SIGTERM) 06:33:07.295363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18069): Terminating (SIGTERM) 06:33:07.337482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18072): Terminating (SIGTERM) 06:33:07.379793 --- ParallelTerminationStrategy: PID 18061 died... 06:33:07.400008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18061): Terminated: ok {rc=0} 06:33:07.446544 --- ParallelTerminationStrategy: PID 18062 died... 06:33:07.466152 run iperf3-srv_10.42.42.10(pid=18062): Terminated {rc=256} 06:33:07.512441 --- ParallelTerminationStrategy: PID 18066 died... 06:33:07.532195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18066): Terminated: ok {rc=0} 06:33:07.578436 --- ParallelTerminationStrategy: PID 18069 died... 06:33:07.598335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18069): Terminated: ok {rc=0} 06:33:07.644571 --- ParallelTerminationStrategy: PID 18072 died... 06:33:07.664311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18072): Terminated: ok {rc=0} 06:33:07.753258 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 06:33:08.906746 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:08.918795 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:33:08.958768 tst iperf3m4.py: using LAC 39063 06:33:09.082991 tst iperf3m4.py: using RAC 48 06:33:09.206890 tst iperf3m4.py: using CellId 39063 06:33:09.330701 tst iperf3m4.py: using BVCI 39064 06:33:09.445795 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.456653 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.467591 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.478464 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.489616 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.500492 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.511733 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.522873 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:09.534082 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:33:09.655798 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:33:09.780005 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:33:09.898798 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:33:10.017918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:33:10.244711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:10.582881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18074): Launched 06:33:10.874480 run iperf3-srv_10.42.42.10(pid=18075): Launched 06:33:11.000336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:33:11.226801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:11.564371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18076): Launched 06:33:11.856072 run iperf3-srv_10.42.42.10(pid=18077): Launched 06:33:11.981222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:33:12.207717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:12.544831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18078): Launched 06:33:12.836641 run iperf3-srv_10.42.42.10(pid=18079): Launched 06:33:12.964107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:33:13.190131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:13.527418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18080): Launched 06:33:13.818960 run iperf3-srv_10.42.42.10(pid=18081): Launched 06:33:13.946136 tst iperf3m4.py:8: start network... 06:33:14.171905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:14.690904 run create_hlr_db(pid=18082): Launched 06:33:14.828040 bus /gobi_6: Setting Powered False 06:33:15.918700 run create_hlr_db(pid=18082): Terminated: ok {rc=0} 06:33:16.400007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18084): Launched 06:33:16.753349 run osmo-hlr_10.42.42.2(pid=18085): Launched 06:33:16.983438 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:17.632890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18087): Launched 06:33:17.968027 run osmo-stp_10.42.42.5(pid=18088): Launched 06:33:18.094961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:18.672538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18090): Launched 06:33:18.800868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:19.084749 run patchelf(pid=18091): Launched 06:33:19.273991 run osmo-stp_10.42.42.5(pid=18088): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18088)] 06:33:19.415754 run osmo-stp_10.42.42.5(pid=18088): stdout: | (launched: 2022-12-14_06:33:17.906778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:19.559413 run osmo-stp_10.42.42.5(pid=18088): stderr: | 20221214063318099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063318100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063318100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063318100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063318101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063318101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063318101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:19.702982 run osmo-stp_10.42.42.5(pid=18088): stdout: | (launched: 2022-12-14_06:33:17.906778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:19.840619 run osmo-stp_10.42.42.5(pid=18088): stderr: | 20221214063318099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063318100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063318100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063318100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063318101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063318101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063318101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:20.003159 run patchelf(pid=18091): Terminating (SIGINT) 06:33:20.190730 run patchelf(pid=18091): Terminated: ok {rc=0} 06:33:20.326536 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18088): Process ended prematurely: osmo-stp_10.42.42.5(pid=18088) [trial-2400↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18088)] [trial-2400↪gprs:nanobts+band-1900↪iperf3m4.py:8] 06:33:20.336883 tst iperf3m4.py:8: Test FAILED (11.5 sec) 06:33:20.365765 run osmo-hlr_10.42.42.2(pid=18085): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18085)] 06:33:20.416105 run osmo-hlr_10.42.42.2(pid=18085): stdout: | (launched: 2022-12-14_06:33:16.689661) 06:33:20.468182 run osmo-hlr_10.42.42.2(pid=18085): stderr: | 20221214063316916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063316916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063316916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063316916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063316916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063316916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063316932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063316952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063316952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063316952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:20.520923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18074): Terminating (SIGTERM) 06:33:20.563127 run iperf3-srv_10.42.42.10(pid=18075): Terminating (SIGTERM) 06:33:20.605491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18076): Terminating (SIGTERM) 06:33:20.647743 run iperf3-srv_10.42.42.10(pid=18077): Terminating (SIGTERM) 06:33:20.689847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18078): Terminating (SIGTERM) 06:33:20.732437 run iperf3-srv_10.42.42.10(pid=18079): Terminating (SIGTERM) 06:33:20.774639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18080): Terminating (SIGTERM) 06:33:20.817031 run iperf3-srv_10.42.42.10(pid=18081): Terminating (SIGTERM) 06:33:20.859003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18084): Terminating (SIGTERM) 06:33:20.901149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18087): Terminating (SIGTERM) 06:33:20.943188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18090): Terminating (SIGTERM) 06:33:20.986035 --- ParallelTerminationStrategy: PID 18074 died... 06:33:21.006790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18074): Terminated: ok {rc=0} 06:33:21.053791 --- ParallelTerminationStrategy: PID 18075 died... 06:33:21.073974 run iperf3-srv_10.42.42.10(pid=18075): Terminated {rc=256} 06:33:21.120829 --- ParallelTerminationStrategy: PID 18076 died... 06:33:21.141401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18076): Terminated: ok {rc=0} 06:33:21.188297 --- ParallelTerminationStrategy: PID 18077 died... 06:33:21.208462 run iperf3-srv_10.42.42.10(pid=18077): Terminated {rc=256} 06:33:21.255120 --- ParallelTerminationStrategy: PID 18078 died... 06:33:21.275146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18078): Terminated: ok {rc=0} 06:33:21.321725 --- ParallelTerminationStrategy: PID 18079 died... 06:33:21.341806 run iperf3-srv_10.42.42.10(pid=18079): Terminated {rc=256} 06:33:21.388342 --- ParallelTerminationStrategy: PID 18080 died... 06:33:21.408450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18080): Terminated: ok {rc=0} 06:33:21.455625 --- ParallelTerminationStrategy: PID 18081 died... 06:33:21.475790 run iperf3-srv_10.42.42.10(pid=18081): Terminated {rc=256} 06:33:21.522922 --- ParallelTerminationStrategy: PID 18084 died... 06:33:21.543040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18084): Terminated: ok {rc=0} 06:33:21.589789 --- ParallelTerminationStrategy: PID 18087 died... 06:33:21.609970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18087): Terminated: ok {rc=0} 06:33:21.656561 --- ParallelTerminationStrategy: PID 18090 died... 06:33:21.676700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18090): Terminated: ok {rc=0} 06:33:21.766731 bus /gobi_4: Setting Powered False 06:33:22.866707 bus /gobi_4: Setting Powered False 06:33:23.982719 bus /gobi_1: Setting Powered False 06:33:25.079463 bus /gobi_1: Setting Powered False 06:33:26.195971 bus /gobi_0: Setting Powered False 06:33:27.290971 bus /gobi_0: Setting Powered False 06:33:28.405866 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 06:33:29.509706 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:29.521914 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:33:29.561529 tst ping.py: using LAC 39064 06:33:29.690569 tst ping.py: using RAC 49 06:33:29.821433 tst ping.py: using CellId 39064 06:33:29.951655 tst ping.py: using BVCI 39065 06:33:30.065636 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.076550 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.087452 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.098377 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.109422 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.120382 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.131310 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:30.142473 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:33:30.258233 tst ping.py:19: start network... 06:33:30.465128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:30.963912 run create_hlr_db(pid=18092): Launched 06:33:31.131436 bus /gobi_6: Setting Powered False 06:33:32.212469 run create_hlr_db(pid=18092): Terminated: ok {rc=0} 06:33:32.659165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18094): Launched 06:33:32.968427 run osmo-hlr_10.42.42.2(pid=18095): Launched 06:33:33.086865 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:33.631142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18097): Launched 06:33:33.940522 run osmo-stp_10.42.42.5(pid=18098): Launched 06:33:34.059465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:34.591136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18100): Launched 06:33:34.708729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:34.969446 run patchelf(pid=18101): Launched 06:33:35.140194 run osmo-stp_10.42.42.5(pid=18098): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18098)] 06:33:35.271003 run osmo-stp_10.42.42.5(pid=18098): stdout: | (launched: 2022-12-14_06:33:33.883884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:35.402805 run osmo-stp_10.42.42.5(pid=18098): stderr: | 20221214063334055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063334056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063334056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063334056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063334057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063334057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063334057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:35.534746 run osmo-stp_10.42.42.5(pid=18098): stdout: | (launched: 2022-12-14_06:33:33.883884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:35.660464 run osmo-stp_10.42.42.5(pid=18098): stderr: | 20221214063334055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063334056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063334056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063334056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063334057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063334057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063334057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:35.809935 run patchelf(pid=18101): Terminating (SIGINT) 06:33:35.982040 run patchelf(pid=18101): Terminated: ok {rc=0} 06:33:36.106110 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18098): Process ended prematurely: osmo-stp_10.42.42.5(pid=18098) [trial-2400↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18098)] [trial-2400↪gprs:nanobts+band-1900↪ping.py:22] 06:33:36.115170 tst ping.py:22: Test FAILED (6.6 sec) 06:33:36.141975 run osmo-hlr_10.42.42.2(pid=18095): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18095)] 06:33:36.190257 run osmo-hlr_10.42.42.2(pid=18095): stdout: | (launched: 2022-12-14_06:33:32.911047) 06:33:36.239776 run osmo-hlr_10.42.42.2(pid=18095): stderr: | 20221214063333089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063333089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063333089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063333089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063333089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063333089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063333101 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063333109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063333110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063333110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:36.289611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18094): Terminating (SIGTERM) 06:33:36.329947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18097): Terminating (SIGTERM) 06:33:36.370370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18100): Terminating (SIGTERM) 06:33:36.410831 --- ParallelTerminationStrategy: PID 18094 died... 06:33:36.430449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18094): Terminated: ok {rc=0} 06:33:36.474931 --- ParallelTerminationStrategy: PID 18097 died... 06:33:36.494145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18097): Terminated: ok {rc=0} 06:33:36.538580 --- ParallelTerminationStrategy: PID 18100 died... 06:33:36.557650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18100): Terminated: ok {rc=0} 06:33:36.644416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 06:33:37.733295 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:37.745491 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:33:37.785693 tst ping_idle_ping.py: using LAC 39065 06:33:37.908708 tst ping_idle_ping.py: using RAC 50 06:33:38.030917 tst ping_idle_ping.py: using CellId 39065 06:33:38.160920 tst ping_idle_ping.py: using BVCI 39066 06:33:38.281991 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.293510 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.304725 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.316144 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.327560 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.338985 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.350477 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:33:38.361948 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:33:38.478475 tst ping_idle_ping.py:24: start network... 06:33:38.687436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:39.173746 run create_hlr_db(pid=18102): Launched 06:33:39.291796 bus /gobi_6: Setting Powered False 06:33:40.354712 run create_hlr_db(pid=18102): Terminated: ok {rc=0} 06:33:40.807388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18104): Launched 06:33:41.138719 run osmo-hlr_10.42.42.2(pid=18105): Launched 06:33:41.267094 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:41.837896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18107): Launched 06:33:42.168506 run osmo-stp_10.42.42.5(pid=18108): Launched 06:33:42.294711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:42.866821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18110): Launched 06:33:42.994430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:43.275113 run patchelf(pid=18111): Launched 06:33:43.458828 run osmo-stp_10.42.42.5(pid=18108): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18108)] 06:33:43.598615 run osmo-stp_10.42.42.5(pid=18108): stdout: | (launched: 2022-12-14_06:33:42.107618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:43.740810 run osmo-stp_10.42.42.5(pid=18108): stderr: | 20221214063342301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063342302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063342302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063342302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063342303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063342303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063342303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:43.882482 run osmo-stp_10.42.42.5(pid=18108): stdout: | (launched: 2022-12-14_06:33:42.107618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:44.017733 run osmo-stp_10.42.42.5(pid=18108): stderr: | 20221214063342301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063342302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063342302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063342302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063342303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063342303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063342303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:44.178514 run patchelf(pid=18111): Terminating (SIGINT) 06:33:44.362477 run patchelf(pid=18111): Terminated: ok {rc=0} 06:33:44.494942 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18108): Process ended prematurely: osmo-stp_10.42.42.5(pid=18108) [trial-2400↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18108)] [trial-2400↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 06:33:44.504580 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:33:44.533134 run osmo-hlr_10.42.42.2(pid=18105): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18105)] 06:33:44.583269 run osmo-hlr_10.42.42.2(pid=18105): stdout: | (launched: 2022-12-14_06:33:41.078383) 06:33:44.635454 run osmo-hlr_10.42.42.2(pid=18105): stderr: | 20221214063341277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063341277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063341277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063341277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063341277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063341278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063341290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063341300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063341300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063341300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:44.687937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18104): Terminating (SIGTERM) 06:33:44.730705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18107): Terminating (SIGTERM) 06:33:44.773071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18110): Terminating (SIGTERM) 06:33:44.816234 --- ParallelTerminationStrategy: PID 18104 died... 06:33:44.836858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18104): Terminated: ok {rc=0} 06:33:44.883871 --- ParallelTerminationStrategy: PID 18107 died... 06:33:44.903808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18107): Terminated: ok {rc=0} 06:33:44.950469 --- ParallelTerminationStrategy: PID 18110 died... 06:33:44.970549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18110): Terminated: ok {rc=0} 06:33:45.059113 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 06:33:46.393615 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:33:46.406817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:33:46.439139 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:33:46.491137 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:33:46.606411 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:33:46.633104 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:33:46.673653 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:33:47.272436 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:33:47.327324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.339027 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:33:47.380628 tst cs_paging_gprs_active.py: using LAC 39066 06:33:47.512787 tst cs_paging_gprs_active.py: using RAC 51 06:33:47.643465 tst cs_paging_gprs_active.py: using CellId 39066 06:33:47.785379 tst cs_paging_gprs_active.py: using BVCI 39067 06:33:47.907435 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.919181 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.930679 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.941977 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.953359 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.964748 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.976416 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.987778 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:47.999552 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:33:48.121837 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:33:48.241495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:33:48.453746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:48.770631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18115): Launched 06:33:49.043948 run iperf3-srv_10.42.42.10(pid=18116): Launched 06:33:49.162149 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:33:49.373203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:49.688562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Launched 06:33:49.961339 run iperf3-srv_10.42.42.10(pid=18118): Launched 06:33:50.079183 tst cs_paging_gprs_active.py:38: start network... 06:33:50.289791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:50.774534 run create_hlr_db(pid=18119): Launched 06:33:50.895918 bus /gobi_6: Setting Powered False 06:33:51.958592 run create_hlr_db(pid=18119): Terminated: ok {rc=0} 06:33:52.413119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18121): Launched 06:33:52.747999 run osmo-hlr_10.42.42.2(pid=18122): Launched 06:33:52.875676 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:53.451025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18124): Launched 06:33:53.785278 run osmo-stp_10.42.42.5(pid=18125): Launched 06:33:53.912343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:54.487710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18127): Launched 06:33:54.616910 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:54.900424 run patchelf(pid=18128): Launched 06:33:55.086040 run osmo-stp_10.42.42.5(pid=18125): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18125)] 06:33:55.227595 run osmo-stp_10.42.42.5(pid=18125): stdout: | (launched: 2022-12-14_06:33:53.723713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:55.371414 run osmo-stp_10.42.42.5(pid=18125): stderr: | 20221214063353917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063353917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063353917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063353918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063353918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063353918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063353918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:55.514384 run osmo-stp_10.42.42.5(pid=18125): stdout: | (launched: 2022-12-14_06:33:53.723713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:55.650799 run osmo-stp_10.42.42.5(pid=18125): stderr: | 20221214063353917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063353917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063353917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063353918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063353918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063353918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063353918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:55.813137 run patchelf(pid=18128): Terminating (SIGINT) 06:33:55.999628 run patchelf(pid=18128): Terminated: ok {rc=0} 06:33:56.134558 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18125): Process ended prematurely: osmo-stp_10.42.42.5(pid=18125) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18125)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:33:56.145069 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:33:56.173722 run osmo-hlr_10.42.42.2(pid=18122): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18122)] 06:33:56.223673 run osmo-hlr_10.42.42.2(pid=18122): stdout: | (launched: 2022-12-14_06:33:52.686622) 06:33:56.275157 run osmo-hlr_10.42.42.2(pid=18122): stderr: | 20221214063352887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063352887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063352888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063352888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063352888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063352888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063352899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063352908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063352908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063352908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:56.327365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18115): Terminating (SIGTERM) 06:33:56.369339 run iperf3-srv_10.42.42.10(pid=18116): Terminating (SIGTERM) 06:33:56.411128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Terminating (SIGTERM) 06:33:56.453481 run iperf3-srv_10.42.42.10(pid=18118): Terminating (SIGTERM) 06:33:56.495321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18121): Terminating (SIGTERM) 06:33:56.537312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18124): Terminating (SIGTERM) 06:33:56.580518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18127): Terminating (SIGTERM) 06:33:56.622496 --- ParallelTerminationStrategy: PID 18115 died... 06:33:56.642611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18115): Terminated: ok {rc=0} 06:33:56.689054 --- ParallelTerminationStrategy: PID 18116 died... 06:33:56.708443 run iperf3-srv_10.42.42.10(pid=18116): Terminated {rc=256} 06:33:56.754865 --- ParallelTerminationStrategy: PID 18117 died... 06:33:56.774519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Terminated: ok {rc=0} 06:33:56.820620 --- ParallelTerminationStrategy: PID 18118 died... 06:33:56.840219 run iperf3-srv_10.42.42.10(pid=18118): Terminated {rc=256} 06:33:56.886042 --- ParallelTerminationStrategy: PID 18121 died... 06:33:56.905622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18121): Terminated: ok {rc=0} 06:33:56.951489 --- ParallelTerminationStrategy: PID 18124 died... 06:33:56.971099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18124): Terminated: ok {rc=0} 06:33:57.017098 --- ParallelTerminationStrategy: PID 18127 died... 06:33:57.036822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18127): Terminated: ok {rc=0} 06:33:57.125036 bus /gobi_0: Setting Powered False 06:33:58.223214 bus /gobi_0: Setting Powered False 06:33:59.337960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:34:00.487969 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:00.500415 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:34:00.546017 tst iperf3.py: using LAC 39067 06:34:00.669957 tst iperf3.py: using RAC 52 06:34:00.793894 tst iperf3.py: using CellId 39067 06:34:00.953258 tst iperf3.py: using BVCI 39068 06:34:01.073414 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.085380 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.097141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.108647 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.121229 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.133712 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.146379 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.158910 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:01.171428 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:01.291818 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:34:01.523014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:01.881628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18130): Launched 06:34:02.166648 run iperf3-srv_10.42.42.10(pid=18131): Launched 06:34:02.300681 tst iperf3.py:8: start network... 06:34:02.513964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:03.000629 run create_hlr_db(pid=18132): Launched 06:34:03.120449 bus /gobi_6: Setting Powered False 06:34:04.182615 run create_hlr_db(pid=18132): Terminated: ok {rc=0} 06:34:04.638722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18134): Launched 06:34:04.974645 run osmo-hlr_10.42.42.2(pid=18135): Launched 06:34:05.102423 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:05.684521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18137): Launched 06:34:06.019448 run osmo-stp_10.42.42.5(pid=18138): Launched 06:34:06.147539 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:06.724329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18140): Launched 06:34:06.852825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:07.136567 run patchelf(pid=18141): Launched 06:34:07.322994 run osmo-stp_10.42.42.5(pid=18138): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18138)] 06:34:07.465148 run osmo-stp_10.42.42.5(pid=18138): stdout: | (launched: 2022-12-14_06:34:05.958670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:07.609032 run osmo-stp_10.42.42.5(pid=18138): stderr: | 20221214063406152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063406153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063406153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063406153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063406154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063406154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063406154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:07.752740 run osmo-stp_10.42.42.5(pid=18138): stdout: | (launched: 2022-12-14_06:34:05.958670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:07.889938 run osmo-stp_10.42.42.5(pid=18138): stderr: | 20221214063406152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063406153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063406153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063406153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063406154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063406154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063406154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:08.052095 run patchelf(pid=18141): Terminating (SIGINT) 06:34:08.239307 run patchelf(pid=18141): Terminated: ok {rc=0} 06:34:08.374302 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18138): Process ended prematurely: osmo-stp_10.42.42.5(pid=18138) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18138)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 06:34:08.384579 tst iperf3.py:8: Test FAILED (7.9 sec) 06:34:08.413466 run osmo-hlr_10.42.42.2(pid=18135): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18135)] 06:34:08.464187 run osmo-hlr_10.42.42.2(pid=18135): stdout: | (launched: 2022-12-14_06:34:04.913294) 06:34:08.516601 run osmo-hlr_10.42.42.2(pid=18135): stderr: | 20221214063405113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063405113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063405113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063405113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063405113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063405113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063405126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063405136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063405136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063405136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:08.569773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18130): Terminating (SIGTERM) 06:34:08.611964 run iperf3-srv_10.42.42.10(pid=18131): Terminating (SIGTERM) 06:34:08.654372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18134): Terminating (SIGTERM) 06:34:08.697322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18137): Terminating (SIGTERM) 06:34:08.739891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18140): Terminating (SIGTERM) 06:34:08.782728 --- ParallelTerminationStrategy: PID 18130 died... 06:34:08.803222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18130): Terminated: ok {rc=0} 06:34:08.850211 --- ParallelTerminationStrategy: PID 18131 died... 06:34:08.870389 run iperf3-srv_10.42.42.10(pid=18131): Terminated {rc=256} 06:34:08.916814 --- ParallelTerminationStrategy: PID 18134 died... 06:34:08.937352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18134): Terminated: ok {rc=0} 06:34:08.984173 --- ParallelTerminationStrategy: PID 18137 died... 06:34:09.004357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18137): Terminated: ok {rc=0} 06:34:09.051023 --- ParallelTerminationStrategy: PID 18140 died... 06:34:09.071193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18140): Terminated: ok {rc=0} 06:34:09.160428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:34:10.312530 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.325295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:34:10.368556 tst iperf3m4.py: using LAC 39068 06:34:10.500903 tst iperf3m4.py: using RAC 53 06:34:10.632307 tst iperf3m4.py: using CellId 39068 06:34:10.765844 tst iperf3m4.py: using BVCI 39069 06:34:10.888597 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.900376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.911713 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.923323 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.935103 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.946931 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.958998 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.970813 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:10.982851 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:11.106510 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:11.231654 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:11.354968 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:11.475671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:34:11.689486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:12.007312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18142): Launched 06:34:12.282795 run iperf3-srv_10.42.42.10(pid=18143): Launched 06:34:12.401466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:34:12.613909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:12.932187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18144): Launched 06:34:13.206755 run iperf3-srv_10.42.42.10(pid=18145): Launched 06:34:13.326843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:34:13.539059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:13.856762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18146): Launched 06:34:14.130864 run iperf3-srv_10.42.42.10(pid=18147): Launched 06:34:14.250909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:34:14.462387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:14.780316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18148): Launched 06:34:15.055443 run iperf3-srv_10.42.42.10(pid=18149): Launched 06:34:15.173620 tst iperf3m4.py:8: start network... 06:34:15.385045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:15.877650 run create_hlr_db(pid=18150): Launched 06:34:16.020066 bus /gobi_6: Setting Powered False 06:34:17.083013 run create_hlr_db(pid=18150): Terminated: ok {rc=0} 06:34:17.528053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18152): Launched 06:34:17.845058 run osmo-hlr_10.42.42.2(pid=18153): Launched 06:34:17.965083 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:18.519059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18155): Launched 06:34:18.836175 run osmo-stp_10.42.42.5(pid=18156): Launched 06:34:18.955907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:19.499610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18158): Launched 06:34:19.621222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:19.888654 run patchelf(pid=18159): Launched 06:34:20.063443 run osmo-stp_10.42.42.5(pid=18156): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18156)] 06:34:20.196494 run osmo-stp_10.42.42.5(pid=18156): stdout: | (launched: 2022-12-14_06:34:18.777761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:20.331512 run osmo-stp_10.42.42.5(pid=18156): stderr: | 20221214063418948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063418948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063418948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063418949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063418949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063418949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063418950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:20.466588 run osmo-stp_10.42.42.5(pid=18156): stdout: | (launched: 2022-12-14_06:34:18.777761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:20.595496 run osmo-stp_10.42.42.5(pid=18156): stderr: | 20221214063418948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063418948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063418948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063418949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063418949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063418949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063418950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:20.747792 run patchelf(pid=18159): Terminating (SIGINT) 06:34:20.924323 run patchelf(pid=18159): Terminated: ok {rc=0} 06:34:21.051845 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18156): Process ended prematurely: osmo-stp_10.42.42.5(pid=18156) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18156)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 06:34:21.061517 tst iperf3m4.py:8: Test FAILED (10.8 sec) 06:34:21.088881 run osmo-hlr_10.42.42.2(pid=18153): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18153)] 06:34:21.137763 run osmo-hlr_10.42.42.2(pid=18153): stdout: | (launched: 2022-12-14_06:34:17.786777) 06:34:21.187764 run osmo-hlr_10.42.42.2(pid=18153): stderr: | 20221214063417964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063417965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063417965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063417965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063417965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063417965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063417978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063417988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063417989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063417989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:21.238425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18142): Terminating (SIGTERM) 06:34:21.278982 run iperf3-srv_10.42.42.10(pid=18143): Terminating (SIGTERM) 06:34:21.319139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18144): Terminating (SIGTERM) 06:34:21.359549 run iperf3-srv_10.42.42.10(pid=18145): Terminating (SIGTERM) 06:34:21.399904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18146): Terminating (SIGTERM) 06:34:21.440386 run iperf3-srv_10.42.42.10(pid=18147): Terminating (SIGTERM) 06:34:21.480711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18148): Terminating (SIGTERM) 06:34:21.521198 run iperf3-srv_10.42.42.10(pid=18149): Terminating (SIGTERM) 06:34:21.561348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18152): Terminating (SIGTERM) 06:34:21.601708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18155): Terminating (SIGTERM) 06:34:21.641992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18158): Terminating (SIGTERM) 06:34:21.682735 --- ParallelTerminationStrategy: PID 18142 died... 06:34:21.702693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18142): Terminated: ok {rc=0} 06:34:21.747751 --- ParallelTerminationStrategy: PID 18143 died... 06:34:21.767033 run iperf3-srv_10.42.42.10(pid=18143): Terminated {rc=256} 06:34:21.812140 --- ParallelTerminationStrategy: PID 18144 died... 06:34:21.831708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18144): Terminated: ok {rc=0} 06:34:21.876880 --- ParallelTerminationStrategy: PID 18145 died... 06:34:21.896701 run iperf3-srv_10.42.42.10(pid=18145): Terminated {rc=256} 06:34:21.941173 --- ParallelTerminationStrategy: PID 18146 died... 06:34:21.960243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18146): Terminated: ok {rc=0} 06:34:22.004516 --- ParallelTerminationStrategy: PID 18147 died... 06:34:22.023777 run iperf3-srv_10.42.42.10(pid=18147): Terminated {rc=256} 06:34:22.067989 --- ParallelTerminationStrategy: PID 18148 died... 06:34:22.087290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18148): Terminated: ok {rc=0} 06:34:22.131853 --- ParallelTerminationStrategy: PID 18149 died... 06:34:22.151058 run iperf3-srv_10.42.42.10(pid=18149): Terminated {rc=256} 06:34:22.195253 --- ParallelTerminationStrategy: PID 18152 died... 06:34:22.214477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18152): Terminated: ok {rc=0} 06:34:22.258948 --- ParallelTerminationStrategy: PID 18155 died... 06:34:22.278470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18155): Terminated: ok {rc=0} 06:34:22.323132 --- ParallelTerminationStrategy: PID 18158 died... 06:34:22.342660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18158): Terminated: ok {rc=0} 06:34:22.427157 bus /gobi_4: Setting Powered False 06:34:23.526461 bus /gobi_4: Setting Powered False 06:34:24.646128 bus /gobi_1: Setting Powered False 06:34:25.744487 bus /gobi_1: Setting Powered False 06:34:26.859609 bus /gobi_0: Setting Powered False 06:34:27.959020 bus /gobi_0: Setting Powered False 06:34:29.076429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 06:34:30.179781 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.191722 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:34:30.233560 tst ping.py: using LAC 39069 06:34:30.363784 tst ping.py: using RAC 54 06:34:30.486522 tst ping.py: using CellId 39069 06:34:30.609782 tst ping.py: using BVCI 39070 06:34:30.721923 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.733068 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.744195 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.755196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.766613 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.778266 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.789884 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:30.801368 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:30.927840 tst ping.py:19: start network... 06:34:31.162326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:31.679192 run create_hlr_db(pid=18160): Launched 06:34:31.832596 bus /gobi_6: Setting Powered False 06:34:32.893991 run create_hlr_db(pid=18160): Terminated: ok {rc=0} 06:34:33.323783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18162): Launched 06:34:33.632781 run osmo-hlr_10.42.42.2(pid=18163): Launched 06:34:33.750992 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:34.296791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18165): Launched 06:34:34.604122 run osmo-stp_10.42.42.5(pid=18166): Launched 06:34:34.722896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:35.255291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18168): Launched 06:34:35.373649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:35.634993 run patchelf(pid=18169): Launched 06:34:35.806427 run osmo-stp_10.42.42.5(pid=18166): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18166)] 06:34:35.936855 run osmo-stp_10.42.42.5(pid=18166): stdout: | (launched: 2022-12-14_06:34:34.547737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:36.068794 run osmo-stp_10.42.42.5(pid=18166): stderr: | 20221214063434716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063434716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063434717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063434717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063434717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063434718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063434718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:36.201377 run osmo-stp_10.42.42.5(pid=18166): stdout: | (launched: 2022-12-14_06:34:34.547737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:36.327275 run osmo-stp_10.42.42.5(pid=18166): stderr: | 20221214063434716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063434716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063434717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063434717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063434717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063434718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063434718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:36.476283 run patchelf(pid=18169): Terminating (SIGINT) 06:34:36.648342 run patchelf(pid=18169): Terminated: ok {rc=0} 06:34:36.772421 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18166): Process ended prematurely: osmo-stp_10.42.42.5(pid=18166) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18166)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 06:34:36.781611 tst ping.py:22: Test FAILED (6.6 sec) 06:34:36.808366 run osmo-hlr_10.42.42.2(pid=18163): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18163)] 06:34:36.856042 run osmo-hlr_10.42.42.2(pid=18163): stdout: | (launched: 2022-12-14_06:34:33.575510) 06:34:36.905370 run osmo-hlr_10.42.42.2(pid=18163): stderr: | 20221214063433751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063433751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063433751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063433751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063433751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063433751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063433764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063433773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063433774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063433774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:36.955098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18162): Terminating (SIGTERM) 06:34:36.995058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18165): Terminating (SIGTERM) 06:34:37.034951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18168): Terminating (SIGTERM) 06:34:37.075206 --- ParallelTerminationStrategy: PID 18162 died... 06:34:37.094760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18162): Terminated: ok {rc=0} 06:34:37.139017 --- ParallelTerminationStrategy: PID 18165 died... 06:34:37.158177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18165): Terminated: ok {rc=0} 06:34:37.202866 --- ParallelTerminationStrategy: PID 18168 died... 06:34:37.221834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18168): Terminated: ok {rc=0} 06:34:37.307859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:34:38.395006 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.406835 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:34:38.447971 tst ping_idle_ping.py: using LAC 39070 06:34:38.570662 tst ping_idle_ping.py: using RAC 55 06:34:38.692937 tst ping_idle_ping.py: using CellId 39070 06:34:38.816822 tst ping_idle_ping.py: using BVCI 39071 06:34:38.929716 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.940695 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.951494 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.962315 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.973477 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.984568 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:38.995986 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:34:39.007204 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:34:39.129386 tst ping_idle_ping.py:24: start network... 06:34:39.352210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:39.870773 run create_hlr_db(pid=18170): Launched 06:34:40.004140 bus /gobi_6: Setting Powered False 06:34:41.070104 run create_hlr_db(pid=18170): Terminated: ok {rc=0} 06:34:41.511603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18172): Launched 06:34:41.821719 run osmo-hlr_10.42.42.2(pid=18173): Launched 06:34:41.939771 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:42.485550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18175): Launched 06:34:42.794261 run osmo-stp_10.42.42.5(pid=18176): Launched 06:34:42.914690 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:43.449523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18178): Launched 06:34:43.567434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:43.829739 run patchelf(pid=18179): Launched 06:34:44.001650 run osmo-stp_10.42.42.5(pid=18176): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18176)] 06:34:44.132784 run osmo-stp_10.42.42.5(pid=18176): stdout: | (launched: 2022-12-14_06:34:42.737253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:44.265589 run osmo-stp_10.42.42.5(pid=18176): stderr: | 20221214063442908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063442908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063442908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063442909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063442909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063442909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063442909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:44.398873 run osmo-stp_10.42.42.5(pid=18176): stdout: | (launched: 2022-12-14_06:34:42.737253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:44.525529 run osmo-stp_10.42.42.5(pid=18176): stderr: | 20221214063442908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063442908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063442908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063442909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063442909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063442909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063442909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:44.675538 run patchelf(pid=18179): Terminating (SIGINT) 06:34:44.848370 run patchelf(pid=18179): Terminated: ok {rc=0} 06:34:44.972809 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18176): Process ended prematurely: osmo-stp_10.42.42.5(pid=18176) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18176)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 06:34:44.981864 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:34:45.008506 run osmo-hlr_10.42.42.2(pid=18173): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18173)] 06:34:45.056455 run osmo-hlr_10.42.42.2(pid=18173): stdout: | (launched: 2022-12-14_06:34:41.764102) 06:34:45.105757 run osmo-hlr_10.42.42.2(pid=18173): stderr: | 20221214063441941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063441941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063441942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063441942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063441942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063441942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063441954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063441962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063441963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063441963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:45.155445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18172): Terminating (SIGTERM) 06:34:45.195567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18175): Terminating (SIGTERM) 06:34:45.235511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18178): Terminating (SIGTERM) 06:34:45.275747 --- ParallelTerminationStrategy: PID 18172 died... 06:34:45.295452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18172): Terminated: ok {rc=0} 06:34:45.339955 --- ParallelTerminationStrategy: PID 18175 died... 06:34:45.359172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18175): Terminated: ok {rc=0} 06:34:45.403570 --- ParallelTerminationStrategy: PID 18178 died... 06:34:45.422569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18178): Terminated: ok {rc=0} 06:34:45.506846 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:34:46.803253 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:46.811255 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:34:46.835970 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:34:46.878949 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:34:46.975671 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:34:47.025151 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:34:47.081227 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:34:47.629412 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:34:47.681817 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:47.692936 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:34:47.751256 tst cs_paging_gprs_active.py: using LAC 39071 06:34:47.875912 tst cs_paging_gprs_active.py: using RAC 56 06:34:47.997578 tst cs_paging_gprs_active.py: using CellId 39071 06:34:48.128502 tst cs_paging_gprs_active.py: using BVCI 39072 06:34:48.250475 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.262269 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.274190 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.285743 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.297760 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.309651 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.321618 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.333436 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:48.345593 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:34:48.465514 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:34:48.588577 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:34:48.816702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:49.153415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18183): Launched 06:34:49.445456 run iperf3-srv_10.42.42.10(pid=18184): Launched 06:34:49.572370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:34:49.800218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:34:50.137718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18185): Launched 06:34:50.431346 run iperf3-srv_10.42.42.10(pid=18186): Launched 06:34:50.557156 tst cs_paging_gprs_active.py:38: start network... 06:34:50.783946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:51.301827 run create_hlr_db(pid=18187): Launched 06:34:51.439095 bus /gobi_6: Setting Powered False 06:34:52.504688 run create_hlr_db(pid=18187): Terminated: ok {rc=0} 06:34:52.951211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18189): Launched 06:34:53.265595 run osmo-hlr_10.42.42.2(pid=18190): Launched 06:34:53.385362 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:53.939335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18192): Launched 06:34:54.253834 run osmo-stp_10.42.42.5(pid=18193): Launched 06:34:54.374099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:54.914404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18195): Launched 06:34:55.042548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:55.325673 run patchelf(pid=18196): Launched 06:34:55.511250 run osmo-stp_10.42.42.5(pid=18193): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18193)] 06:34:55.652514 run osmo-stp_10.42.42.5(pid=18193): stdout: | (launched: 2022-12-14_06:34:54.195902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:55.796923 run osmo-stp_10.42.42.5(pid=18193): stderr: | 20221214063454369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063454370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063454370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063454370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063454371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063454371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063454371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:55.940149 run osmo-stp_10.42.42.5(pid=18193): stdout: | (launched: 2022-12-14_06:34:54.195902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:56.076579 run osmo-stp_10.42.42.5(pid=18193): stderr: | 20221214063454369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063454370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063454370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063454370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063454371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063454371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063454371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:56.238246 run patchelf(pid=18196): Terminating (SIGINT) 06:34:56.424661 run patchelf(pid=18196): Terminated: ok {rc=0} 06:34:56.559247 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18193): Process ended prematurely: osmo-stp_10.42.42.5(pid=18193) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18193)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:34:56.569649 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:34:56.598598 run osmo-hlr_10.42.42.2(pid=18190): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18190)] 06:34:56.648742 run osmo-hlr_10.42.42.2(pid=18190): stdout: | (launched: 2022-12-14_06:34:53.207935) 06:34:56.700790 run osmo-hlr_10.42.42.2(pid=18190): stderr: | 20221214063453385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063453385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063453385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063453385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063453385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063453385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063453398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063453406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063453406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063453406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:56.753488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18183): Terminating (SIGTERM) 06:34:56.795973 run iperf3-srv_10.42.42.10(pid=18184): Terminating (SIGTERM) 06:34:56.839156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18185): Terminating (SIGTERM) 06:34:56.881286 run iperf3-srv_10.42.42.10(pid=18186): Terminating (SIGTERM) 06:34:56.923257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18189): Terminating (SIGTERM) 06:34:56.965500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18192): Terminating (SIGTERM) 06:34:57.007981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18195): Terminating (SIGTERM) 06:34:57.050455 --- ParallelTerminationStrategy: PID 18183 died... 06:34:57.070862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18183): Terminated: ok {rc=0} 06:34:57.117356 --- ParallelTerminationStrategy: PID 18184 died... 06:34:57.137048 run iperf3-srv_10.42.42.10(pid=18184): Terminated {rc=256} 06:34:57.183059 --- ParallelTerminationStrategy: PID 18185 died... 06:34:57.202831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18185): Terminated: ok {rc=0} 06:34:57.248865 --- ParallelTerminationStrategy: PID 18186 died... 06:34:57.268535 run iperf3-srv_10.42.42.10(pid=18186): Terminated {rc=256} 06:34:57.314643 --- ParallelTerminationStrategy: PID 18189 died... 06:34:57.334602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18189): Terminated: ok {rc=0} 06:34:57.380812 --- ParallelTerminationStrategy: PID 18192 died... 06:34:57.401029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18192): Terminated: ok {rc=0} 06:34:57.447097 --- ParallelTerminationStrategy: PID 18195 died... 06:34:57.466746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18195): Terminated: ok {rc=0} 06:34:57.555268 bus /gobi_0: Setting Powered False 06:34:58.654235 bus /gobi_0: Setting Powered False 06:34:59.769823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:35:00.940047 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:00.952067 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:35:01.024160 tst iperf3.py: using LAC 39072 06:35:01.156565 tst iperf3.py: using RAC 57 06:35:01.314914 tst iperf3.py: using CellId 39072 06:35:01.448721 tst iperf3.py: using BVCI 39073 06:35:01.582441 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.594351 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.605759 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.617143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.629731 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.642784 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.656067 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.669242 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:01.681948 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:01.804264 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:35:02.022528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:35:02.346199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18201): Launched 06:35:02.621369 run iperf3-srv_10.42.42.10(pid=18202): Launched 06:35:02.740090 tst iperf3.py:8: start network... 06:35:02.963462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:03.482470 run create_hlr_db(pid=18203): Launched 06:35:03.618342 bus /gobi_6: Setting Powered False 06:35:04.683785 run create_hlr_db(pid=18203): Terminated: ok {rc=0} 06:35:05.131117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18205): Launched 06:35:05.446658 run osmo-hlr_10.42.42.2(pid=18206): Launched 06:35:05.566658 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:06.125107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18208): Launched 06:35:06.437372 run osmo-stp_10.42.42.5(pid=18209): Launched 06:35:06.556758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:35:07.097992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18211): Launched 06:35:07.218605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:35:07.484434 run patchelf(pid=18212): Launched 06:35:07.659423 run osmo-stp_10.42.42.5(pid=18209): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18209)] 06:35:07.792394 run osmo-stp_10.42.42.5(pid=18209): stdout: | (launched: 2022-12-14_06:35:06.379902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:07.927618 run osmo-stp_10.42.42.5(pid=18209): stderr: | 20221214063506550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063506550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063506551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063506551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063506552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063506552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063506552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:08.062889 run osmo-stp_10.42.42.5(pid=18209): stdout: | (launched: 2022-12-14_06:35:06.379902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:08.191628 run osmo-stp_10.42.42.5(pid=18209): stderr: | 20221214063506550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063506550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063506551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063506551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063506552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063506552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063506552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:08.344081 run patchelf(pid=18212): Terminating (SIGINT) 06:35:08.520425 run patchelf(pid=18212): Terminated: ok {rc=0} 06:35:08.647517 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18209): Process ended prematurely: osmo-stp_10.42.42.5(pid=18209) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18209)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 06:35:08.657227 tst iperf3.py:8: Test FAILED (7.8 sec) 06:35:08.684445 run osmo-hlr_10.42.42.2(pid=18206): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18206)] 06:35:08.733118 run osmo-hlr_10.42.42.2(pid=18206): stdout: | (launched: 2022-12-14_06:35:05.389498) 06:35:08.783445 run osmo-hlr_10.42.42.2(pid=18206): stderr: | 20221214063505567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063505567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063505567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063505567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063505567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063505568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063505583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063505593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063505594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063505594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:08.834160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18201): Terminating (SIGTERM) 06:35:08.874712 run iperf3-srv_10.42.42.10(pid=18202): Terminating (SIGTERM) 06:35:08.915207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18205): Terminating (SIGTERM) 06:35:08.955638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18208): Terminating (SIGTERM) 06:35:08.996046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18211): Terminating (SIGTERM) 06:35:09.036844 --- ParallelTerminationStrategy: PID 18201 died... 06:35:09.056742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18201): Terminated: ok {rc=0} 06:35:09.101647 --- ParallelTerminationStrategy: PID 18202 died... 06:35:09.120695 run iperf3-srv_10.42.42.10(pid=18202): Terminated {rc=256} 06:35:09.165292 --- ParallelTerminationStrategy: PID 18205 died... 06:35:09.184466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18205): Terminated: ok {rc=0} 06:35:09.228698 --- ParallelTerminationStrategy: PID 18208 died... 06:35:09.247983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18208): Terminated: ok {rc=0} 06:35:09.292290 --- ParallelTerminationStrategy: PID 18211 died... 06:35:09.311564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18211): Terminated: ok {rc=0} 06:35:09.399008 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:35:10.552800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:10.565312 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:35:10.628794 tst iperf3m4.py: using LAC 39073 06:35:10.758982 tst iperf3m4.py: using RAC 58 06:35:10.891280 tst iperf3m4.py: using CellId 39073 06:35:11.022997 tst iperf3m4.py: using BVCI 39074 06:35:11.145978 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.157607 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.168835 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.180155 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.191391 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.202699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.214198 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.225437 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:11.236826 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:11.356008 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:11.481144 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:11.604596 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:11.726807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:35:11.954185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:35:12.290889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18213): Launched 06:35:12.583977 run iperf3-srv_10.42.42.10(pid=18214): Launched 06:35:12.709074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:35:12.935791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:35:13.272680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18215): Launched 06:35:13.563679 run iperf3-srv_10.42.42.10(pid=18216): Launched 06:35:13.689277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:35:13.916706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:35:14.254387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18217): Launched 06:35:14.547267 run iperf3-srv_10.42.42.10(pid=18218): Launched 06:35:14.674096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:35:14.899980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:35:15.237558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18219): Launched 06:35:15.530222 run iperf3-srv_10.42.42.10(pid=18220): Launched 06:35:15.656743 tst iperf3m4.py:8: start network... 06:35:15.907896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:16.437745 run create_hlr_db(pid=18221): Launched 06:35:16.603189 bus /gobi_6: Setting Powered False 06:35:17.664915 run create_hlr_db(pid=18221): Terminated: ok {rc=0} 06:35:18.126964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18223): Launched 06:35:18.461606 run osmo-hlr_10.42.42.2(pid=18224): Launched 06:35:18.588696 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:19.163539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18226): Launched 06:35:19.497335 run osmo-stp_10.42.42.5(pid=18227): Launched 06:35:19.623903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:35:20.202587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18230): Launched 06:35:20.330774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:35:20.614882 run patchelf(pid=18231): Launched 06:35:20.800309 run osmo-stp_10.42.42.5(pid=18227): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18227)] 06:35:20.941214 run osmo-stp_10.42.42.5(pid=18227): stdout: | (launched: 2022-12-14_06:35:19.436193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:21.084100 run osmo-stp_10.42.42.5(pid=18227): stderr: | 20221214063519628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063519628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063519629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063519629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063519629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063519630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063519630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:21.226831 run osmo-stp_10.42.42.5(pid=18227): stdout: | (launched: 2022-12-14_06:35:19.436193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:21.363290 run osmo-stp_10.42.42.5(pid=18227): stderr: | 20221214063519628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063519628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063519629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063519629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063519629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063519630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063519630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:21.525068 run patchelf(pid=18231): Terminating (SIGINT) 06:35:21.711559 run patchelf(pid=18231): Terminated: ok {rc=0} 06:35:21.846650 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18227): Process ended prematurely: osmo-stp_10.42.42.5(pid=18227) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18227)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:35:21.857090 tst iperf3m4.py:8: Test FAILED (11.3 sec) 06:35:21.886295 run osmo-hlr_10.42.42.2(pid=18224): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18224)] 06:35:21.936922 run osmo-hlr_10.42.42.2(pid=18224): stdout: | (launched: 2022-12-14_06:35:18.400504) 06:35:21.989468 run osmo-hlr_10.42.42.2(pid=18224): stderr: | 20221214063518600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063518600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063518600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063518600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063518600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063518601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063518617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063518625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063518625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063518626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:22.042096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18213): Terminating (SIGTERM) 06:35:22.084498 run iperf3-srv_10.42.42.10(pid=18214): Terminating (SIGTERM) 06:35:22.126933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18215): Terminating (SIGTERM) 06:35:22.169322 run iperf3-srv_10.42.42.10(pid=18216): Terminating (SIGTERM) 06:35:22.211666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18217): Terminating (SIGTERM) 06:35:22.254208 run iperf3-srv_10.42.42.10(pid=18218): Terminating (SIGTERM) 06:35:22.296629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18219): Terminating (SIGTERM) 06:35:22.339550 run iperf3-srv_10.42.42.10(pid=18220): Terminating (SIGTERM) 06:35:22.381734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18223): Terminating (SIGTERM) 06:35:22.424580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18226): Terminating (SIGTERM) 06:35:22.466914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18230): Terminating (SIGTERM) 06:35:22.509617 --- ParallelTerminationStrategy: PID 18213 died... 06:35:22.529987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18213): Terminated: ok {rc=0} 06:35:22.576849 --- ParallelTerminationStrategy: PID 18214 died... 06:35:22.597081 run iperf3-srv_10.42.42.10(pid=18214): Terminated {rc=256} 06:35:22.643413 --- ParallelTerminationStrategy: PID 18215 died... 06:35:22.663344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18215): Terminated: ok {rc=0} 06:35:22.710155 --- ParallelTerminationStrategy: PID 18216 died... 06:35:22.730036 run iperf3-srv_10.42.42.10(pid=18216): Terminated {rc=256} 06:35:22.776540 --- ParallelTerminationStrategy: PID 18217 died... 06:35:22.796421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18217): Terminated: ok {rc=0} 06:35:22.843345 --- ParallelTerminationStrategy: PID 18218 died... 06:35:22.863204 run iperf3-srv_10.42.42.10(pid=18218): Terminated {rc=256} 06:35:22.909453 --- ParallelTerminationStrategy: PID 18219 died... 06:35:22.929405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18219): Terminated: ok {rc=0} 06:35:22.976172 --- ParallelTerminationStrategy: PID 18220 died... 06:35:22.996017 run iperf3-srv_10.42.42.10(pid=18220): Terminated {rc=256} 06:35:23.042237 --- ParallelTerminationStrategy: PID 18223 died... 06:35:23.062075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18223): Terminated: ok {rc=0} 06:35:23.108429 --- ParallelTerminationStrategy: PID 18226 died... 06:35:23.128349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18226): Terminated: ok {rc=0} 06:35:23.174538 --- ParallelTerminationStrategy: PID 18230 died... 06:35:23.194473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18230): Terminated: ok {rc=0} 06:35:23.282881 bus /gobi_4: Setting Powered False 06:35:24.380062 bus /gobi_4: Setting Powered False 06:35:25.493421 bus /gobi_1: Setting Powered False 06:35:26.593280 bus /gobi_1: Setting Powered False 06:35:27.709882 bus /gobi_0: Setting Powered False 06:35:28.809180 bus /gobi_0: Setting Powered False 06:35:29.927454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:35:31.034419 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.047810 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:35:31.112312 tst ping.py: using LAC 39074 06:35:31.239414 tst ping.py: using RAC 59 06:35:31.398862 tst ping.py: using CellId 39074 06:35:31.559537 tst ping.py: using BVCI 39075 06:35:31.714129 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.728607 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.741537 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.755651 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.771708 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.785717 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.799354 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:31.811759 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:31.953040 tst ping.py:19: start network... 06:35:32.165923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:32.646006 run create_hlr_db(pid=18232): Launched 06:35:32.763851 bus /gobi_6: Setting Powered False 06:35:33.826017 run create_hlr_db(pid=18232): Terminated: ok {rc=0} 06:35:34.256653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18234): Launched 06:35:34.565169 run osmo-hlr_10.42.42.2(pid=18235): Launched 06:35:34.682859 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:35.223668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18237): Launched 06:35:35.532208 run osmo-stp_10.42.42.5(pid=18238): Launched 06:35:35.651234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:35:36.184655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18240): Launched 06:35:36.302554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:35:36.562733 run patchelf(pid=18241): Launched 06:35:36.735187 run osmo-stp_10.42.42.5(pid=18238): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18238)] 06:35:36.864929 run osmo-stp_10.42.42.5(pid=18238): stdout: | (launched: 2022-12-14_06:35:35.475361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:36.996677 run osmo-stp_10.42.42.5(pid=18238): stderr: | 20221214063535645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063535645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063535645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063535646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063535646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063535646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063535646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:37.128406 run osmo-stp_10.42.42.5(pid=18238): stdout: | (launched: 2022-12-14_06:35:35.475361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:37.253740 run osmo-stp_10.42.42.5(pid=18238): stderr: | 20221214063535645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063535645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063535645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063535646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063535646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063535646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063535646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:37.402706 run patchelf(pid=18241): Terminating (SIGINT) 06:35:37.574830 run patchelf(pid=18241): Terminated: ok {rc=0} 06:35:37.698945 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18238): Process ended prematurely: osmo-stp_10.42.42.5(pid=18238) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18238)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 06:35:37.708113 tst ping.py:22: Test FAILED (6.7 sec) 06:35:37.734849 run osmo-hlr_10.42.42.2(pid=18235): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18235)] 06:35:37.782664 run osmo-hlr_10.42.42.2(pid=18235): stdout: | (launched: 2022-12-14_06:35:34.508304) 06:35:37.831928 run osmo-hlr_10.42.42.2(pid=18235): stderr: | 20221214063534684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063534684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063534684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063534684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063534685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063534685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063534697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063534705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063534706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063534706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:37.881611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18234): Terminating (SIGTERM) 06:35:37.921457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18237): Terminating (SIGTERM) 06:35:37.961347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18240): Terminating (SIGTERM) 06:35:38.002250 --- ParallelTerminationStrategy: PID 18234 died... 06:35:38.021875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18234): Terminated: ok {rc=0} 06:35:38.066308 --- ParallelTerminationStrategy: PID 18237 died... 06:35:38.085487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18237): Terminated: ok {rc=0} 06:35:38.129743 --- ParallelTerminationStrategy: PID 18240 died... 06:35:38.148754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18240): Terminated: ok {rc=0} 06:35:38.235141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:35:39.323621 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.335507 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:35:39.400803 tst ping_idle_ping.py: using LAC 39075 06:35:39.522067 tst ping_idle_ping.py: using RAC 60 06:35:39.641525 tst ping_idle_ping.py: using CellId 39075 06:35:39.763684 tst ping_idle_ping.py: using BVCI 39076 06:35:39.877858 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.888846 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.899754 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.910726 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.922282 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.934030 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.945839 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:35:39.957604 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:35:40.079771 tst ping_idle_ping.py:24: start network... 06:35:40.303650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:40.817267 run create_hlr_db(pid=18242): Launched 06:35:40.950332 bus /gobi_6: Setting Powered False 06:35:42.016309 run create_hlr_db(pid=18242): Terminated: ok {rc=0} 06:35:42.456203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18244): Launched 06:35:42.785635 run osmo-hlr_10.42.42.2(pid=18245): Launched 06:35:42.913098 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:43.484625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18247): Launched 06:35:43.813511 run osmo-stp_10.42.42.5(pid=18248): Launched 06:35:43.940096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:35:44.507236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18250): Launched 06:35:44.634310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:35:44.913245 run patchelf(pid=18251): Launched 06:35:45.095646 run osmo-stp_10.42.42.5(pid=18248): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18248)] 06:35:45.235256 run osmo-stp_10.42.42.5(pid=18248): stdout: | (launched: 2022-12-14_06:35:43.753253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:45.376385 run osmo-stp_10.42.42.5(pid=18248): stderr: | 20221214063543946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063543946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063543946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063543947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063543947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063543947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063543947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:45.517292 run osmo-stp_10.42.42.5(pid=18248): stdout: | (launched: 2022-12-14_06:35:43.753253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:45.651825 run osmo-stp_10.42.42.5(pid=18248): stderr: | 20221214063543946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063543946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063543946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063543947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063543947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063543947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063543947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:45.811835 run patchelf(pid=18251): Terminating (SIGINT) 06:35:46.013392 run patchelf(pid=18251): Terminated: ok {rc=0} 06:35:46.156661 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18248): Process ended prematurely: osmo-stp_10.42.42.5(pid=18248) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18248)] [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:35:46.171005 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:35:46.209078 run osmo-hlr_10.42.42.2(pid=18245): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18245)] 06:35:46.271952 run osmo-hlr_10.42.42.2(pid=18245): stdout: | (launched: 2022-12-14_06:35:42.725713) 06:35:46.324066 run osmo-hlr_10.42.42.2(pid=18245): stderr: | 20221214063542923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063542923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063542923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063542923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063542923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063542924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063542935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063542945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063542945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063542945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:46.377841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18244): Terminating (SIGTERM) 06:35:46.420097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18247): Terminating (SIGTERM) 06:35:46.464739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18250): Terminating (SIGTERM) 06:35:46.509521 --- ParallelTerminationStrategy: PID 18244 died... 06:35:46.530997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18244): Terminated: ok {rc=0} 06:35:46.581810 --- ParallelTerminationStrategy: PID 18247 died... 06:35:46.601630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18247): Terminated: ok {rc=0} 06:35:46.648821 --- ParallelTerminationStrategy: PID 18250 died... 06:35:46.669910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18250): Terminated: ok {rc=0} 06:35:46.758118 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 06:35:48.047744 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:48.055356 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:35:48.078774 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:35:48.113415 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:35:48.168211 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:35:48.192779 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:35:48.228453 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:35:48.786049 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:35:48.791120 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:48.802753 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:35:48.862636 tst switch_tch_pdch.py: using LAC 39076 06:35:48.982699 tst switch_tch_pdch.py: using RAC 61 06:35:49.104384 tst switch_tch_pdch.py: using CellId 39076 06:35:49.226533 tst switch_tch_pdch.py: using BVCI 39077 06:35:49.339703 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.351373 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.362900 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.374308 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.386023 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.397707 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.409660 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:35:49.421435 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:35:49.542008 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:35:49.661452 tst switch_tch_pdch.py:51: start network... 06:35:49.869390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:50.346253 run create_hlr_db(pid=18256): Launched 06:35:50.463330 bus /gobi_6: Setting Powered False 06:35:51.524649 run create_hlr_db(pid=18256): Terminated: ok {rc=0} 06:35:51.977388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18260): Launched 06:35:52.289166 run osmo-hlr_10.42.42.2(pid=18261): Launched 06:35:52.407037 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:52.949884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18263): Launched 06:35:53.257305 run osmo-stp_10.42.42.5(pid=18264): Launched 06:35:53.375057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:35:53.909763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18266): Launched 06:35:54.027530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:35:54.288070 run patchelf(pid=18267): Launched 06:35:54.458934 run osmo-stp_10.42.42.5(pid=18264): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18264)] 06:35:54.589339 run osmo-stp_10.42.42.5(pid=18264): stdout: | (launched: 2022-12-14_06:35:53.200394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:54.720800 run osmo-stp_10.42.42.5(pid=18264): stderr: | 20221214063553371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063553371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063553372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063553372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063553373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063553373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063553373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:54.852712 run osmo-stp_10.42.42.5(pid=18264): stdout: | (launched: 2022-12-14_06:35:53.200394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:54.978570 run osmo-stp_10.42.42.5(pid=18264): stderr: | 20221214063553371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063553371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063553372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063553372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063553373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063553373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063553373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:55.127998 run patchelf(pid=18267): Terminating (SIGINT) 06:35:55.300329 run patchelf(pid=18267): Terminated: ok {rc=0} 06:35:55.424645 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18264): Process ended prematurely: osmo-stp_10.42.42.5(pid=18264) [trial-2400↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18264)] [trial-2400↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:35:55.433882 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 06:35:55.460571 run osmo-hlr_10.42.42.2(pid=18261): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18261)] 06:35:55.508757 run osmo-hlr_10.42.42.2(pid=18261): stdout: | (launched: 2022-12-14_06:35:52.232373) 06:35:55.558478 run osmo-hlr_10.42.42.2(pid=18261): stderr: | 20221214063552408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063552408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063552408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063552408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063552409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063552409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063552421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063552429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063552429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063552429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:55.608377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18260): Terminating (SIGTERM) 06:35:55.648502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18263): Terminating (SIGTERM) 06:35:55.688467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18266): Terminating (SIGTERM) 06:35:55.728708 --- ParallelTerminationStrategy: PID 18260 died... 06:35:55.748235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18260): Terminated: ok {rc=0} 06:35:55.792490 --- ParallelTerminationStrategy: PID 18263 died... 06:35:55.811831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18263): Terminated: ok {rc=0} 06:35:55.855915 --- ParallelTerminationStrategy: PID 18266 died... 06:35:55.874955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18266): Terminated: ok {rc=0} 06:35:55.961465 bus /gobi_0: Setting Powered False 06:35:57.060300 bus /gobi_0: Setting Powered False 06:35:58.172593 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 sms:nanobts+band-900 --------------------------------------------------------------------- 06:35:59.412452 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:59.417360 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:35:59.448858 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:35:59.476386 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 06:35:59.527970 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:35:59.562008 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:35:59.590111 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 06:36:00.133483 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 06:36:00.139247 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:00.150457 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 06:36:00.197252 tst mo_mt_sms.py: using LAC 39077 06:36:00.338340 tst mo_mt_sms.py: using RAC 62 06:36:00.476657 tst mo_mt_sms.py: using CellId 39077 06:36:00.605711 tst mo_mt_sms.py: using BVCI 39078 06:36:00.726240 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:00.737650 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:00.748658 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:00.759787 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:00.770939 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:00.781993 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 06:36:00.914394 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 06:36:01.043868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:01.640645 run create_hlr_db(pid=18271): Launched 06:36:01.769793 bus /gobi_6: Setting Powered False 06:36:02.834665 run create_hlr_db(pid=18271): Terminated: ok {rc=0} 06:36:03.272882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Launched 06:36:03.581660 run osmo-hlr_10.42.42.2(pid=18274): Launched 06:36:03.698811 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:04.243507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Launched 06:36:04.551702 run osmo-stp_10.42.42.5(pid=18277): Launched 06:36:04.669925 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:05.227421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18279): Launched 06:36:05.535946 run osmo-msc_10.42.42.6(pid=18280): Launched 06:36:05.708792 run osmo-stp_10.42.42.5(pid=18277): ERR: Terminated: ERROR {rc=1} [trial-2400↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] 06:36:05.839307 run osmo-stp_10.42.42.5(pid=18277): stdout: | (launched: 2022-12-14_06:36:04.495154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:05.969825 run osmo-stp_10.42.42.5(pid=18277): stderr: | 20221214063604666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063604666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063604666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063604667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063604667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063604667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063604667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:06.097579 run osmo-stp_10.42.42.5(pid=18277): stdout: | (launched: 2022-12-14_06:36:04.495154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:06.220046 run osmo-stp_10.42.42.5(pid=18277): stderr: | 20221214063604666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063604666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063604666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063604667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063604667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063604667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063604667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:06.366955 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18277): Process ended prematurely: osmo-stp_10.42.42.5(pid=18277) [trial-2400↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] [trial-2400↪sms:nanobts+band-900↪mo_mt_sms.py:16] 06:36:06.375427 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 06:36:06.401679 run osmo-hlr_10.42.42.2(pid=18274): ERR: Terminated: ERROR {rc=237} [trial-2400↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18274)] 06:36:06.450045 run osmo-hlr_10.42.42.2(pid=18274): stdout: | (launched: 2022-12-14_06:36:03.524289) 06:36:06.499795 run osmo-hlr_10.42.42.2(pid=18274): stderr: | 20221214063603702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063603702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063603702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063603702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063603702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063603702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063603714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063603722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063603723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063603723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:06.569380 run osmo-msc_10.42.42.6(pid=18280): ERR: Terminated: ERROR {rc=2} [trial-2400↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18280)] 06:36:06.617257 run osmo-msc_10.42.42.6(pid=18280): stdout: | (launched: 2022-12-14_06:36:05.479328) 06:36:06.666665 run osmo-msc_10.42.42.6(pid=18280): stderr: | 20221214063605752 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063605752 DLGLOBAL DEBUG validating counter group 0x7f202a655c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063605752 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063605752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063605752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063605752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063605754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063605754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063605755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063605755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:06.716502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Terminating (SIGTERM) 06:36:06.756626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Terminating (SIGTERM) 06:36:06.796545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18279): Terminating (SIGTERM) 06:36:06.836772 --- ParallelTerminationStrategy: PID 18273 died... 06:36:06.856287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Terminated: ok {rc=0} 06:36:06.900394 --- ParallelTerminationStrategy: PID 18276 died... 06:36:06.919355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Terminated: ok {rc=0} 06:36:06.963355 --- ParallelTerminationStrategy: PID 18279 died... 06:36:06.982557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18279): Terminated: ok {rc=0} 06:36:07.068821 bus /sierra_3: Setting Powered False 06:36:08.168735 bus /sierra_3: Setting Powered False 06:36:09.284144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 06:36:10.520511 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:10.525837 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:36:10.559028 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 06:36:10.566309 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 06:36:10.603701 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:36:10.636453 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 06:36:10.643364 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 06:36:11.161011 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 06:36:11.168370 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 06:36:11.179887 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 06:36:11.228647 tst assert_extension.py: using LAC 39078 06:36:11.358591 tst assert_extension.py: using RAC 63 06:36:11.488526 tst assert_extension.py: using CellId 39078 06:36:11.617151 tst assert_extension.py: using BVCI 39079 06:36:11.736227 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 06:36:11.851002 tst assert_extension.py:10: start nitb and bts... 06:36:12.058674 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:36:12.687380 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18285): Launched 06:36:12.995274 run osmo-nitb_10.42.42.2(pid=18286): Launched 06:36:13.166075 run osmo-nitb_10.42.42.2(pid=18286): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] 06:36:13.303728 run osmo-nitb_10.42.42.2(pid=18286): stdout: | (launched: 2022-12-14_06:36:12.938731) 06:36:13.443420 run osmo-nitb_10.42.42.2(pid=18286): stderr: | (launched: 2022-12-14_06:36:12.984448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:36:13.583002 run osmo-nitb_10.42.42.2(pid=18286): stdout: | (launched: 2022-12-14_06:36:12.938731) 06:36:13.716802 run osmo-nitb_10.42.42.2(pid=18286): stderr: | (launched: 2022-12-14_06:36:12.984448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18286) [trial-2400↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] 06:36:14.112056 tst osmo-nitb_10.42.42.2(pid=18286): stdout: | (launched: 2022-12-14_06:36:12.938731) 06:36:14.236457 tst osmo-nitb_10.42.42.2(pid=18286): stderr: | (launched: 2022-12-14_06:36:12.984448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:36:14.383804 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18286) [trial-2400↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] [trial-2400↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 06:36:14.392366 tst assert_extension.py:12: Test FAILED (3.2 sec) 06:36:14.398931 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18285): Terminating (SIGTERM) 06:36:14.607803 --- ParallelTerminationStrategy: PID 18285 died... 06:36:14.628566 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18285): Terminated: ok {rc=0} 06:36:14.715765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 ussd:nanobts+band-900 --------------------------------------------------------------------- 06:36:15.899835 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:15.905731 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:36:15.949303 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:36:15.988373 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 06:36:16.041973 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:36:16.075963 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:36:16.104703 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 06:36:16.658628 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 06:36:16.666995 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:16.686604 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 06:36:16.744380 tst assert_extension.py: using LAC 39079 06:36:16.868259 tst assert_extension.py: using RAC 64 06:36:16.991893 tst assert_extension.py: using CellId 39079 06:36:17.114855 tst assert_extension.py: using BVCI 39080 06:36:17.240796 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:17.252908 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:17.264870 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:17.277038 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:17.290052 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:17.302918 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 06:36:17.426649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:17.937327 run create_hlr_db(pid=18290): Launched 06:36:18.070659 bus /sierra_2: Setting Powered False 06:36:19.135366 run create_hlr_db(pid=18290): Terminated: ok {rc=0} 06:36:19.577092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18292): Launched 06:36:19.889269 run osmo-hlr_10.42.42.2(pid=18293): Launched 06:36:20.007086 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:20.553391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18295): Launched 06:36:20.862349 run osmo-stp_10.42.42.5(pid=18296): Launched 06:36:20.979695 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:21.534845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18298): Launched 06:36:21.842820 run osmo-msc_10.42.42.6(pid=18299): Launched 06:36:22.018366 run osmo-stp_10.42.42.5(pid=18296): ERR: Terminated: ERROR {rc=1} [trial-2400↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18296)] 06:36:22.149784 run osmo-stp_10.42.42.5(pid=18296): stdout: | (launched: 2022-12-14_06:36:20.804895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:22.279949 run osmo-stp_10.42.42.5(pid=18296): stderr: | 20221214063620977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063620977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063620978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063620978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063620979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063620979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063620979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:22.408347 run osmo-stp_10.42.42.5(pid=18296): stdout: | (launched: 2022-12-14_06:36:20.804895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:22.531676 run osmo-stp_10.42.42.5(pid=18296): stderr: | 20221214063620977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063620977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063620978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063620978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063620979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063620979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063620979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:22.678663 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18296): Process ended prematurely: osmo-stp_10.42.42.5(pid=18296) [trial-2400↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18296)] [trial-2400↪ussd:nanobts+band-900↪assert_extension.py:17] 06:36:22.687160 tst assert_extension.py:17: Test FAILED (6.0 sec) 06:36:22.713162 run osmo-hlr_10.42.42.2(pid=18293): ERR: Terminated: ERROR {rc=237} [trial-2400↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18293)] 06:36:22.761337 run osmo-hlr_10.42.42.2(pid=18293): stdout: | (launched: 2022-12-14_06:36:19.832347) 06:36:22.810825 run osmo-hlr_10.42.42.2(pid=18293): stderr: | 20221214063620010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063620010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063620010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063620010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063620010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063620010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063620025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063620034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063620034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063620034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:22.880393 run osmo-msc_10.42.42.6(pid=18299): ERR: Terminated: ERROR {rc=2} [trial-2400↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18299)] 06:36:22.927769 run osmo-msc_10.42.42.6(pid=18299): stdout: | (launched: 2022-12-14_06:36:21.786006) 06:36:22.977286 run osmo-msc_10.42.42.6(pid=18299): stderr: | 20221214063622057 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063622057 DLGLOBAL DEBUG validating counter group 0x7f470f52ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063622058 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063622058 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063622058 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063622058 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063622060 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063622060 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063622060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063622060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:23.027310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18292): Terminating (SIGTERM) 06:36:23.067245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18295): Terminating (SIGTERM) 06:36:23.107310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18298): Terminating (SIGTERM) 06:36:23.148527 --- ParallelTerminationStrategy: PID 18292 died... 06:36:23.168115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18292): Terminated: ok {rc=0} 06:36:23.213427 --- ParallelTerminationStrategy: PID 18295 died... 06:36:23.232686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18295): Terminated: ok {rc=0} 06:36:23.277425 --- ParallelTerminationStrategy: PID 18298 died... 06:36:23.296653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18298): Terminated: ok {rc=0} 06:36:23.383070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:36:24.606657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:24.616174 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:36:24.650876 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:36:24.679256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:36:24.734766 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:36:24.768226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:36:24.796729 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:36:25.343317 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:36:25.396127 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:25.407613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:36:25.473583 tst mo_mt_call.py: using LAC 39080 06:36:25.608021 tst mo_mt_call.py: using RAC 65 06:36:25.743065 tst mo_mt_call.py: using CellId 39080 06:36:25.875216 tst mo_mt_call.py: using BVCI 39081 06:36:25.998256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:26.010225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:26.022089 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:26.033881 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:26.045979 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:26.058008 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:36:26.175348 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:36:26.292546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:26.778666 run create_hlr_db(pid=18304): Launched 06:36:26.899281 bus /sierra_2: Setting Powered False 06:36:27.961275 run create_hlr_db(pid=18304): Terminated: ok {rc=0} 06:36:28.419497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18306): Launched 06:36:28.755826 run osmo-hlr_10.42.42.2(pid=18307): Launched 06:36:28.883370 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:29.464059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18309): Launched 06:36:29.798739 run osmo-stp_10.42.42.5(pid=18310): Launched 06:36:29.926233 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:30.529635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18312): Launched 06:36:30.887739 run osmo-msc_10.42.42.6(pid=18313): Launched 06:36:31.286527 run osmo-stp_10.42.42.5(pid=18310): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18310)] 06:36:31.563253 run osmo-stp_10.42.42.5(pid=18310): stdout: | (launched: 2022-12-14_06:36:29.737492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:31.788649 run osmo-stp_10.42.42.5(pid=18310): stderr: | 20221214063629931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063629932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063629932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063629932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063629933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063629933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063629933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:31.954940 run osmo-stp_10.42.42.5(pid=18310): stdout: | (launched: 2022-12-14_06:36:29.737492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:32.083662 run osmo-stp_10.42.42.5(pid=18310): stderr: | 20221214063629931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063629932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063629932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063629932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063629933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063629933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063629933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:32.240540 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18310): Process ended prematurely: osmo-stp_10.42.42.5(pid=18310) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18310)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:36:32.250779 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 06:36:32.278651 run osmo-hlr_10.42.42.2(pid=18307): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18307)] 06:36:32.330678 run osmo-hlr_10.42.42.2(pid=18307): stdout: | (launched: 2022-12-14_06:36:28.695139) 06:36:32.384193 run osmo-hlr_10.42.42.2(pid=18307): stderr: | 20221214063628896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063628896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063628896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063628896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063628896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063628896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063628910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063628918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063628918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063628918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:32.454672 run osmo-msc_10.42.42.6(pid=18313): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18313)] 06:36:32.502908 run osmo-msc_10.42.42.6(pid=18313): stdout: | (launched: 2022-12-14_06:36:30.802343) 06:36:32.553274 run osmo-msc_10.42.42.6(pid=18313): stderr: | 20221214063631465 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063631465 DLGLOBAL DEBUG validating counter group 0x7fb5c3de4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063631465 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063631465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063631465 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063631465 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063631467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063631467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063631468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063631468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:32.603804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18306): Terminating (SIGTERM) 06:36:32.644549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18309): Terminating (SIGTERM) 06:36:32.685387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18312): Terminating (SIGTERM) 06:36:32.726351 --- ParallelTerminationStrategy: PID 18306 died... 06:36:32.746149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18306): Terminated: ok {rc=0} 06:36:32.791216 --- ParallelTerminationStrategy: PID 18309 died... 06:36:32.810637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18309): Terminated: ok {rc=0} 06:36:32.855695 --- ParallelTerminationStrategy: PID 18312 died... 06:36:32.875379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18312): Terminated: ok {rc=0} 06:36:32.963286 bus /sierra_3: Setting Powered False 06:36:34.062742 bus /sierra_3: Setting Powered False 06:36:35.178953 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:36:36.327602 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:36.339559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:36:36.405369 tst mo_mt_call_osmux.py: using LAC 39081 06:36:36.526367 tst mo_mt_call_osmux.py: using RAC 66 06:36:36.650937 tst mo_mt_call_osmux.py: using CellId 39081 06:36:36.773853 tst mo_mt_call_osmux.py: using BVCI 39082 06:36:36.889380 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:36.900516 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:36.911615 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:36.922715 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:36.934162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:36:36.945581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:36:37.066908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:36:37.192121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:37.714336 run create_hlr_db(pid=18315): Launched 06:36:37.850939 bus /sierra_2: Setting Powered False 06:36:38.917250 run create_hlr_db(pid=18315): Terminated: ok {rc=0} 06:36:39.367437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18317): Launched 06:36:39.683459 run osmo-hlr_10.42.42.2(pid=18318): Launched 06:36:39.803358 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:40.345483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18320): Launched 06:36:40.661197 run osmo-stp_10.42.42.5(pid=18321): Launched 06:36:40.781295 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:41.351628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18323): Launched 06:36:41.667308 run osmo-msc_10.42.42.6(pid=18324): Launched 06:36:41.845313 run osmo-stp_10.42.42.5(pid=18321): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18321)] 06:36:41.978903 run osmo-stp_10.42.42.5(pid=18321): stdout: | (launched: 2022-12-14_06:36:40.603450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:42.111744 run osmo-stp_10.42.42.5(pid=18321): stderr: | 20221214063640776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063640776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063640776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063640776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063640777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063640777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063640777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:42.243028 run osmo-stp_10.42.42.5(pid=18321): stdout: | (launched: 2022-12-14_06:36:40.603450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:42.367904 run osmo-stp_10.42.42.5(pid=18321): stderr: | 20221214063640776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063640776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063640776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063640776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063640777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063640777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063640777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:42.517887 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18321): Process ended prematurely: osmo-stp_10.42.42.5(pid=18321) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18321)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:36:42.527084 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:36:42.553926 run osmo-hlr_10.42.42.2(pid=18318): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18318)] 06:36:42.603038 run osmo-hlr_10.42.42.2(pid=18318): stdout: | (launched: 2022-12-14_06:36:39.625859) 06:36:42.653249 run osmo-hlr_10.42.42.2(pid=18318): stderr: | 20221214063639803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063639803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063639803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063639803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063639803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063639803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063639832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063639842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063639842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063639842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:42.723318 run osmo-msc_10.42.42.6(pid=18324): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18324)] 06:36:42.771231 run osmo-msc_10.42.42.6(pid=18324): stdout: | (launched: 2022-12-14_06:36:41.609281) 06:36:42.821091 run osmo-msc_10.42.42.6(pid=18324): stderr: | 20221214063641881 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063641882 DLGLOBAL DEBUG validating counter group 0x7f35bc465c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063641882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063641882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063641882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063641882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063641884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063641884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063641884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063641885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:42.871400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18317): Terminating (SIGTERM) 06:36:42.912075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18320): Terminating (SIGTERM) 06:36:42.952561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18323): Terminating (SIGTERM) 06:36:42.993370 --- ParallelTerminationStrategy: PID 18317 died... 06:36:43.012883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18317): Terminated: ok {rc=0} 06:36:43.058174 --- ParallelTerminationStrategy: PID 18320 died... 06:36:43.077468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18320): Terminated: ok {rc=0} 06:36:43.122259 --- ParallelTerminationStrategy: PID 18323 died... 06:36:43.141589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18323): Terminated: ok {rc=0} 06:36:43.230011 bus /sierra_3: Setting Powered False 06:36:44.330881 bus /sierra_3: Setting Powered False 06:36:45.448673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:36:46.732194 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:46.740575 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:36:46.775790 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:36:46.804753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:36:46.860777 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:36:46.909550 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:36:46.945969 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:36:47.468745 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:36:47.520755 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:47.531982 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:36:47.597930 tst mo_mt_call.py: using LAC 39082 06:36:47.720570 tst mo_mt_call.py: using RAC 67 06:36:47.845710 tst mo_mt_call.py: using CellId 39082 06:36:47.970825 tst mo_mt_call.py: using BVCI 39083 06:36:48.094059 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:48.106038 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:48.117907 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:48.129840 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:48.142320 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:48.154743 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:36:48.280451 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:36:48.400603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:48.886788 run create_hlr_db(pid=18329): Launched 06:36:49.008387 bus /sierra_2: Setting Powered False 06:36:50.070955 run create_hlr_db(pid=18329): Terminated: ok {rc=0} 06:36:50.527551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18331): Launched 06:36:50.863209 run osmo-hlr_10.42.42.2(pid=18332): Launched 06:36:50.990271 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:51.569678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18334): Launched 06:36:51.903431 run osmo-stp_10.42.42.5(pid=18335): Launched 06:36:52.030500 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:52.635139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18337): Launched 06:36:52.970440 run osmo-msc_10.42.42.6(pid=18338): Launched 06:36:53.157155 run osmo-stp_10.42.42.5(pid=18335): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18335)] 06:36:53.298136 run osmo-stp_10.42.42.5(pid=18335): stdout: | (launched: 2022-12-14_06:36:51.842250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:53.439870 run osmo-stp_10.42.42.5(pid=18335): stderr: | 20221214063652038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063652038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063652038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063652039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063652039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063652039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063652039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:53.578990 run osmo-stp_10.42.42.5(pid=18335): stdout: | (launched: 2022-12-14_06:36:51.842250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:53.711356 run osmo-stp_10.42.42.5(pid=18335): stderr: | 20221214063652038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063652038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063652038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063652039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063652039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063652039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063652039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:53.870394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18335): Process ended prematurely: osmo-stp_10.42.42.5(pid=18335) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18335)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:36:53.880081 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:36:53.908090 run osmo-hlr_10.42.42.2(pid=18332): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18332)] 06:36:53.958112 run osmo-hlr_10.42.42.2(pid=18332): stdout: | (launched: 2022-12-14_06:36:50.802267) 06:36:54.010203 run osmo-hlr_10.42.42.2(pid=18332): stderr: | 20221214063651003 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063651003 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063651003 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063651003 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063651003 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063651004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063651016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063651025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063651025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063651025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:54.082677 run osmo-msc_10.42.42.6(pid=18338): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18338)] 06:36:54.132459 run osmo-msc_10.42.42.6(pid=18338): stdout: | (launched: 2022-12-14_06:36:52.909026) 06:36:54.183958 run osmo-msc_10.42.42.6(pid=18338): stderr: | 20221214063653232 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063653232 DLGLOBAL DEBUG validating counter group 0x7fa8535d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063653232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063653232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063653232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063653232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063653234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063653234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063653235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063653235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:54.235801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18331): Terminating (SIGTERM) 06:36:54.277422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18334): Terminating (SIGTERM) 06:36:54.319730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18337): Terminating (SIGTERM) 06:36:54.362008 --- ParallelTerminationStrategy: PID 18331 died... 06:36:54.382379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18331): Terminated: ok {rc=0} 06:36:54.428528 --- ParallelTerminationStrategy: PID 18334 died... 06:36:54.448352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18334): Terminated: ok {rc=0} 06:36:54.494207 --- ParallelTerminationStrategy: PID 18337 died... 06:36:54.514016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18337): Terminated: ok {rc=0} 06:36:54.602384 bus /sierra_3: Setting Powered False 06:36:55.700620 bus /sierra_3: Setting Powered False 06:36:56.816526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:36:57.967326 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:57.981985 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:36:58.050064 tst mo_mt_call_osmux.py: using LAC 39083 06:36:58.174563 tst mo_mt_call_osmux.py: using RAC 68 06:36:58.299785 tst mo_mt_call_osmux.py: using CellId 39083 06:36:58.437073 tst mo_mt_call_osmux.py: using BVCI 39084 06:36:58.559534 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:58.571488 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:58.583530 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:58.595231 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:58.607162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:36:58.618766 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:36:58.740080 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:36:58.858860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:59.347068 run create_hlr_db(pid=18340): Launched 06:36:59.467236 bus /sierra_2: Setting Powered False 06:37:00.529344 run create_hlr_db(pid=18340): Terminated: ok {rc=0} 06:37:00.997735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18342): Launched 06:37:01.330226 run osmo-hlr_10.42.42.2(pid=18343): Launched 06:37:01.506477 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:02.188428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18345): Launched 06:37:02.534964 run osmo-stp_10.42.42.5(pid=18346): Launched 06:37:02.662300 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:03.267228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18348): Launched 06:37:03.601830 run osmo-msc_10.42.42.6(pid=18349): Launched 06:37:03.787679 run osmo-stp_10.42.42.5(pid=18346): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18346)] 06:37:03.928600 run osmo-stp_10.42.42.5(pid=18346): stdout: | (launched: 2022-12-14_06:37:02.474611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:04.068752 run osmo-stp_10.42.42.5(pid=18346): stderr: | 20221214063702668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063702669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063702669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063702669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063702670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063702670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063702670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:04.207907 run osmo-stp_10.42.42.5(pid=18346): stdout: | (launched: 2022-12-14_06:37:02.474611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:04.341030 run osmo-stp_10.42.42.5(pid=18346): stderr: | 20221214063702668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063702669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063702669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063702669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063702670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063702670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063702670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:04.500244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18346): Process ended prematurely: osmo-stp_10.42.42.5(pid=18346) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18346)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:37:04.510284 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 06:37:04.538401 run osmo-hlr_10.42.42.2(pid=18343): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18343)] 06:37:04.589105 run osmo-hlr_10.42.42.2(pid=18343): stdout: | (launched: 2022-12-14_06:37:01.270608) 06:37:04.641217 run osmo-hlr_10.42.42.2(pid=18343): stderr: | 20221214063701653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063701653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063701653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063701653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063701653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063701654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063701675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063701683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063701683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063701683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:04.713946 run osmo-msc_10.42.42.6(pid=18349): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18349)] 06:37:04.764257 run osmo-msc_10.42.42.6(pid=18349): stdout: | (launched: 2022-12-14_06:37:03.540829) 06:37:04.816165 run osmo-msc_10.42.42.6(pid=18349): stderr: | 20221214063703864 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063703864 DLGLOBAL DEBUG validating counter group 0x7fe27897bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063703864 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063703864 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063703864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063703865 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063703866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063703867 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063703867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063703867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:04.868396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18342): Terminating (SIGTERM) 06:37:04.910369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18345): Terminating (SIGTERM) 06:37:04.952066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18348): Terminating (SIGTERM) 06:37:04.994524 --- ParallelTerminationStrategy: PID 18342 died... 06:37:05.014840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18342): Terminated: ok {rc=0} 06:37:05.061209 --- ParallelTerminationStrategy: PID 18345 died... 06:37:05.081254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18345): Terminated: ok {rc=0} 06:37:05.127503 --- ParallelTerminationStrategy: PID 18348 died... 06:37:05.147402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18348): Terminated: ok {rc=0} 06:37:05.234648 bus /sierra_3: Setting Powered False 06:37:06.333491 bus /sierra_3: Setting Powered False 06:37:07.450074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:37:08.701261 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:37:08.708598 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:37:08.740248 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:37:08.767516 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:37:08.819922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:37:08.853479 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:37:08.881055 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:37:09.429377 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:37:09.480348 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:09.491916 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:37:09.558748 tst mo_mt_call.py: using LAC 39084 06:37:09.680176 tst mo_mt_call.py: using RAC 69 06:37:09.803647 tst mo_mt_call.py: using CellId 39084 06:37:09.927502 tst mo_mt_call.py: using BVCI 39085 06:37:10.050607 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:10.062680 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:10.074583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:10.086473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:10.098554 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:10.110370 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:37:10.228564 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:37:10.350216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:10.869969 run create_hlr_db(pid=18355): Launched 06:37:11.005176 bus /sierra_2: Setting Powered False 06:37:12.071196 run create_hlr_db(pid=18355): Terminated: ok {rc=0} 06:37:12.535416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18357): Launched 06:37:12.871852 run osmo-hlr_10.42.42.2(pid=18358): Launched 06:37:12.999466 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:13.577178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18360): Launched 06:37:13.911092 run osmo-stp_10.42.42.5(pid=18361): Launched 06:37:14.039849 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:14.643134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18363): Launched 06:37:14.979913 run osmo-msc_10.42.42.6(pid=18364): Launched 06:37:15.164410 run osmo-stp_10.42.42.5(pid=18361): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18361)] 06:37:15.303716 run osmo-stp_10.42.42.5(pid=18361): stdout: | (launched: 2022-12-14_06:37:13.850190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:15.443674 run osmo-stp_10.42.42.5(pid=18361): stderr: | 20221214063714044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063714044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063714044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063714045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063714045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063714046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063714046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:15.582742 run osmo-stp_10.42.42.5(pid=18361): stdout: | (launched: 2022-12-14_06:37:13.850190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:15.715245 run osmo-stp_10.42.42.5(pid=18361): stderr: | 20221214063714044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063714044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063714044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063714045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063714045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063714046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063714046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:15.874807 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18361): Process ended prematurely: osmo-stp_10.42.42.5(pid=18361) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18361)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:37:15.885020 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:37:15.914100 run osmo-hlr_10.42.42.2(pid=18358): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18358)] 06:37:15.964935 run osmo-hlr_10.42.42.2(pid=18358): stdout: | (launched: 2022-12-14_06:37:12.810293) 06:37:16.017734 run osmo-hlr_10.42.42.2(pid=18358): stderr: | 20221214063713013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063713013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063713014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063713014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063713014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063713014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063713026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063713034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063713034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063713034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:16.091210 run osmo-msc_10.42.42.6(pid=18364): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18364)] 06:37:16.142283 run osmo-msc_10.42.42.6(pid=18364): stdout: | (launched: 2022-12-14_06:37:14.918562) 06:37:16.194977 run osmo-msc_10.42.42.6(pid=18364): stderr: | 20221214063715244 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063715244 DLGLOBAL DEBUG validating counter group 0x7f618c8b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063715244 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063715244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063715244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063715245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063715246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063715247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063715247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063715247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:16.248094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18357): Terminating (SIGTERM) 06:37:16.290524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18360): Terminating (SIGTERM) 06:37:16.332877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18363): Terminating (SIGTERM) 06:37:16.375670 --- ParallelTerminationStrategy: PID 18357 died... 06:37:16.396153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18357): Terminated: ok {rc=0} 06:37:16.443111 --- ParallelTerminationStrategy: PID 18360 died... 06:37:16.463393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18360): Terminated: ok {rc=0} 06:37:16.510412 --- ParallelTerminationStrategy: PID 18363 died... 06:37:16.530525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18363): Terminated: ok {rc=0} 06:37:16.620253 bus /sierra_3: Setting Powered False 06:37:17.716729 bus /sierra_3: Setting Powered False 06:37:18.829267 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:37:19.981366 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:19.994257 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:37:20.064205 tst mo_mt_call_osmux.py: using LAC 39085 06:37:20.194926 tst mo_mt_call_osmux.py: using RAC 70 06:37:20.326672 tst mo_mt_call_osmux.py: using CellId 39085 06:37:20.456746 tst mo_mt_call_osmux.py: using BVCI 39086 06:37:20.572523 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:20.584282 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:20.595384 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:20.606661 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:20.618308 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:37:20.629906 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:37:20.751614 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:37:20.878492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:21.399618 run create_hlr_db(pid=18366): Launched 06:37:21.537257 bus /sierra_2: Setting Powered False 06:37:22.602547 run create_hlr_db(pid=18366): Terminated: ok {rc=0} 06:37:23.051802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18368): Launched 06:37:23.369927 run osmo-hlr_10.42.42.2(pid=18369): Launched 06:37:23.492364 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:24.039762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18371): Launched 06:37:24.355881 run osmo-stp_10.42.42.5(pid=18372): Launched 06:37:24.476136 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:25.044872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18374): Launched 06:37:25.359235 run osmo-msc_10.42.42.6(pid=18375): Launched 06:37:25.537577 run osmo-stp_10.42.42.5(pid=18372): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18372)] 06:37:25.671479 run osmo-stp_10.42.42.5(pid=18372): stdout: | (launched: 2022-12-14_06:37:24.298122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:25.809261 run osmo-stp_10.42.42.5(pid=18372): stderr: | 20221214063724469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063724469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063724469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063724470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063724470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063724470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063724470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:25.935800 run osmo-stp_10.42.42.5(pid=18372): stdout: | (launched: 2022-12-14_06:37:24.298122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:26.056225 run osmo-stp_10.42.42.5(pid=18372): stderr: | 20221214063724469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063724469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063724469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063724470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063724470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063724470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063724470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:26.200689 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18372): Process ended prematurely: osmo-stp_10.42.42.5(pid=18372) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18372)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:37:26.209594 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:37:26.235369 run osmo-hlr_10.42.42.2(pid=18369): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18369)] 06:37:26.282501 run osmo-hlr_10.42.42.2(pid=18369): stdout: | (launched: 2022-12-14_06:37:23.310897) 06:37:26.330717 run osmo-hlr_10.42.42.2(pid=18369): stderr: | 20221214063723487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063723487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063723487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063723487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063723487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063723488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063723500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063723508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063723508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063723508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:26.398670 run osmo-msc_10.42.42.6(pid=18375): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18375)] 06:37:26.444927 run osmo-msc_10.42.42.6(pid=18375): stdout: | (launched: 2022-12-14_06:37:25.301576) 06:37:26.493092 run osmo-msc_10.42.42.6(pid=18375): stderr: | 20221214063725575 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063725575 DLGLOBAL DEBUG validating counter group 0x7f5e1de80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063725576 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063725576 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063725576 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063725576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063725578 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063725579 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063725579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063725579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:26.541549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18368): Terminating (SIGTERM) 06:37:26.580743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18371): Terminating (SIGTERM) 06:37:26.619695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18374): Terminating (SIGTERM) 06:37:26.658940 --- ParallelTerminationStrategy: PID 18368 died... 06:37:26.678010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18368): Terminated: ok {rc=0} 06:37:26.721115 --- ParallelTerminationStrategy: PID 18371 died... 06:37:26.739690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18371): Terminated: ok {rc=0} 06:37:26.782700 --- ParallelTerminationStrategy: PID 18374 died... 06:37:26.801259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18374): Terminated: ok {rc=0} 06:37:26.883731 bus /sierra_3: Setting Powered False 06:37:27.980033 bus /sierra_3: Setting Powered False 06:37:29.093430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:37:30.342571 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:37:30.350720 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:37:30.383403 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:37:30.410430 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:37:30.463559 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:37:30.496479 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:37:30.523362 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:37:31.078635 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:37:31.133535 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:31.145840 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:37:31.213800 tst mo_mt_call.py: using LAC 39086 06:37:31.338521 tst mo_mt_call.py: using RAC 71 06:37:31.474364 tst mo_mt_call.py: using CellId 39086 06:37:31.616610 tst mo_mt_call.py: using BVCI 39087 06:37:31.759421 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:31.772282 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:31.785177 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:31.797986 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:31.811311 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:31.824420 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:37:31.948102 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:37:32.066179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:32.545707 run create_hlr_db(pid=18381): Launched 06:37:32.661759 bus /sierra_2: Setting Powered False 06:37:33.722400 run create_hlr_db(pid=18381): Terminated: ok {rc=0} 06:37:34.146108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Launched 06:37:34.451070 run osmo-hlr_10.42.42.2(pid=18384): Launched 06:37:34.566242 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:35.092686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Launched 06:37:35.397029 run osmo-stp_10.42.42.5(pid=18387): Launched 06:37:35.512451 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:36.061979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18389): Launched 06:37:36.366283 run osmo-msc_10.42.42.6(pid=18390): Launched 06:37:36.535895 run osmo-stp_10.42.42.5(pid=18387): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] 06:37:36.664468 run osmo-stp_10.42.42.5(pid=18387): stdout: | (launched: 2022-12-14_06:37:35.341434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:36.792839 run osmo-stp_10.42.42.5(pid=18387): stderr: | 20221214063735508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063735509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063735509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063735509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063735510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063735510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063735510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:36.919614 run osmo-stp_10.42.42.5(pid=18387): stdout: | (launched: 2022-12-14_06:37:35.341434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:37.040929 run osmo-stp_10.42.42.5(pid=18387): stderr: | 20221214063735508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063735509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063735509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063735509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063735510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063735510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063735510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:37.185763 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18387): Process ended prematurely: osmo-stp_10.42.42.5(pid=18387) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:37:37.194882 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:37:37.221132 run osmo-hlr_10.42.42.2(pid=18384): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18384)] 06:37:37.268722 run osmo-hlr_10.42.42.2(pid=18384): stdout: | (launched: 2022-12-14_06:37:34.395434) 06:37:37.317493 run osmo-hlr_10.42.42.2(pid=18384): stderr: | 20221214063734566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063734566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063734566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063734566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063734566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063734566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063734579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063734587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063734588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063734588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:37.386070 run osmo-msc_10.42.42.6(pid=18390): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18390)] 06:37:37.432820 run osmo-msc_10.42.42.6(pid=18390): stdout: | (launched: 2022-12-14_06:37:36.310526) 06:37:37.481641 run osmo-msc_10.42.42.6(pid=18390): stderr: | 20221214063736577 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063736578 DLGLOBAL DEBUG validating counter group 0x7fef72511c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063736578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063736578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063736578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063736578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063736580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063736581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063736581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063736581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:37.530469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Terminating (SIGTERM) 06:37:37.569624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Terminating (SIGTERM) 06:37:37.608931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18389): Terminating (SIGTERM) 06:37:37.648502 --- ParallelTerminationStrategy: PID 18383 died... 06:37:37.667892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Terminated: ok {rc=0} 06:37:37.711335 --- ParallelTerminationStrategy: PID 18386 died... 06:37:37.730154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Terminated: ok {rc=0} 06:37:37.773476 --- ParallelTerminationStrategy: PID 18389 died... 06:37:37.792082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18389): Terminated: ok {rc=0} 06:37:37.876351 bus /sierra_3: Setting Powered False 06:37:38.972801 bus /sierra_3: Setting Powered False 06:37:40.085926 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:37:41.230676 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:41.242992 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:37:41.309384 tst mo_mt_call_osmux.py: using LAC 39087 06:37:41.428576 tst mo_mt_call_osmux.py: using RAC 72 06:37:41.549380 tst mo_mt_call_osmux.py: using CellId 39087 06:37:41.668143 tst mo_mt_call_osmux.py: using BVCI 39088 06:37:41.779592 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:41.790802 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:41.802194 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:41.813094 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:41.824412 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:37:41.835677 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:37:41.951249 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:37:42.070630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:42.579475 run create_hlr_db(pid=18392): Launched 06:37:42.711863 bus /sierra_2: Setting Powered False 06:37:43.775623 run create_hlr_db(pid=18392): Terminated: ok {rc=0} 06:37:44.211396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18394): Launched 06:37:44.517755 run osmo-hlr_10.42.42.2(pid=18395): Launched 06:37:44.634129 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:45.164317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18397): Launched 06:37:45.471323 run osmo-stp_10.42.42.5(pid=18398): Launched 06:37:45.589456 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:46.167353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18400): Launched 06:37:46.489994 run osmo-msc_10.42.42.6(pid=18401): Launched 06:37:46.888291 run osmo-stp_10.42.42.5(pid=18398): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18398)] 06:37:47.172493 run osmo-stp_10.42.42.5(pid=18398): stdout: | (launched: 2022-12-14_06:37:45.415537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:47.397477 run osmo-stp_10.42.42.5(pid=18398): stderr: | 20221214063745583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063745583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063745583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063745584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063745584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063745584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063745584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:47.540770 run osmo-stp_10.42.42.5(pid=18398): stdout: | (launched: 2022-12-14_06:37:45.415537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:47.671223 run osmo-stp_10.42.42.5(pid=18398): stderr: | 20221214063745583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063745583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063745583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063745584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063745584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063745584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063745584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:47.826786 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18398): Process ended prematurely: osmo-stp_10.42.42.5(pid=18398) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18398)] [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:37:47.836389 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 06:37:47.864405 run osmo-hlr_10.42.42.2(pid=18395): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18395)] 06:37:47.914400 run osmo-hlr_10.42.42.2(pid=18395): stdout: | (launched: 2022-12-14_06:37:44.462178) 06:37:47.965524 run osmo-hlr_10.42.42.2(pid=18395): stderr: | 20221214063744634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063744634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063744634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063744634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063744634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063744634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063744659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063744668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063744668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063744669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:48.036830 run osmo-msc_10.42.42.6(pid=18401): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18401)] 06:37:48.085832 run osmo-msc_10.42.42.6(pid=18401): stdout: | (launched: 2022-12-14_06:37:46.425335) 06:37:48.136281 run osmo-msc_10.42.42.6(pid=18401): stderr: | 20221214063747023 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063747023 DLGLOBAL DEBUG validating counter group 0x7f27072c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063747023 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063747024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063747026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063747026 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063747033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063747035 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063747036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063747036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:48.187593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18394): Terminating (SIGTERM) 06:37:48.228579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18397): Terminating (SIGTERM) 06:37:48.270094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18400): Terminating (SIGTERM) 06:37:48.311871 --- ParallelTerminationStrategy: PID 18394 died... 06:37:48.331978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18394): Terminated: ok {rc=0} 06:37:48.377604 --- ParallelTerminationStrategy: PID 18397 died... 06:37:48.396745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18397): Terminated: ok {rc=0} 06:37:48.442644 --- ParallelTerminationStrategy: PID 18400 died... 06:37:48.462133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18400): Terminated: ok {rc=0} 06:37:48.548310 bus /sierra_3: Setting Powered False 06:37:49.645998 bus /sierra_3: Setting Powered False 06:37:50.760568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:37:52.034363 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:37:52.042478 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:37:52.075520 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:37:52.103745 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:37:52.156598 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:37:52.189986 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:37:52.217222 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:37:52.765938 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:37:52.816702 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:37:52.827998 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:37:52.894358 tst mo_mt_call.py: using LAC 39088 06:37:53.014752 tst mo_mt_call.py: using RAC 73 06:37:53.135884 tst mo_mt_call.py: using CellId 39088 06:37:53.264696 tst mo_mt_call.py: using BVCI 39089 06:37:53.382697 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:37:53.394612 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:37:53.406281 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:37:53.417982 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:37:53.429926 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:37:53.441738 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:37:53.557338 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:37:53.679560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:54.185691 run create_hlr_db(pid=18408): Launched 06:37:54.317915 bus /sierra_2: Setting Powered False 06:37:55.382434 run create_hlr_db(pid=18408): Terminated: ok {rc=0} 06:37:55.817879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18410): Launched 06:37:56.123593 run osmo-hlr_10.42.42.2(pid=18411): Launched 06:37:56.239111 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:56.777597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18413): Launched 06:37:57.082367 run osmo-stp_10.42.42.5(pid=18414): Launched 06:37:57.198472 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:57.748846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18416): Launched 06:37:58.054398 run osmo-msc_10.42.42.6(pid=18417): Launched 06:37:58.224099 run osmo-stp_10.42.42.5(pid=18414): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18414)] 06:37:58.353433 run osmo-stp_10.42.42.5(pid=18414): stdout: | (launched: 2022-12-14_06:37:57.026417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:58.481746 run osmo-stp_10.42.42.5(pid=18414): stderr: | 20221214063757195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063757195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063757196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063757196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063757197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063757197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063757197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:58.608175 run osmo-stp_10.42.42.5(pid=18414): stdout: | (launched: 2022-12-14_06:37:57.026417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:58.728901 run osmo-stp_10.42.42.5(pid=18414): stderr: | 20221214063757195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063757195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063757196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063757196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063757197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063757197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063757197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:58.873694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18414): Process ended prematurely: osmo-stp_10.42.42.5(pid=18414) [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18414)] [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:37:58.882567 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:37:58.908564 run osmo-hlr_10.42.42.2(pid=18411): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18411)] 06:37:58.955687 run osmo-hlr_10.42.42.2(pid=18411): stdout: | (launched: 2022-12-14_06:37:56.067970) 06:37:59.004346 run osmo-hlr_10.42.42.2(pid=18411): stderr: | 20221214063756239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063756240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063756240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063756240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063756240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063756240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063756253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063756261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063756261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063756261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:59.072828 run osmo-msc_10.42.42.6(pid=18417): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18417)] 06:37:59.119602 run osmo-msc_10.42.42.6(pid=18417): stdout: | (launched: 2022-12-14_06:37:57.998538) 06:37:59.168285 run osmo-msc_10.42.42.6(pid=18417): stderr: | 20221214063758266 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063758266 DLGLOBAL DEBUG validating counter group 0x7efe816fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063758266 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063758266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063758267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063758267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063758268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063758269 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063758269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063758269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:59.217515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18410): Terminating (SIGTERM) 06:37:59.256855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18413): Terminating (SIGTERM) 06:37:59.296008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18416): Terminating (SIGTERM) 06:37:59.335459 --- ParallelTerminationStrategy: PID 18410 died... 06:37:59.355155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18410): Terminated: ok {rc=0} 06:37:59.398704 --- ParallelTerminationStrategy: PID 18413 died... 06:37:59.417326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18413): Terminated: ok {rc=0} 06:37:59.460678 --- ParallelTerminationStrategy: PID 18416 died... 06:37:59.479426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18416): Terminated: ok {rc=0} 06:37:59.564223 bus /sierra_3: Setting Powered False 06:38:00.661671 bus /sierra_3: Setting Powered False 06:38:01.776575 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:38:02.918223 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:38:02.930152 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:38:02.997903 tst mo_mt_call_osmux.py: using LAC 39089 06:38:03.121087 tst mo_mt_call_osmux.py: using RAC 74 06:38:03.239889 tst mo_mt_call_osmux.py: using CellId 39089 06:38:03.360362 tst mo_mt_call_osmux.py: using BVCI 39090 06:38:03.470572 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:38:03.481845 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:38:03.492840 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:38:03.503827 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:38:03.515242 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:38:03.526556 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:38:03.647662 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:38:03.765738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:04.270837 run create_hlr_db(pid=18419): Launched 06:38:04.402791 bus /sierra_2: Setting Powered False 06:38:05.466445 run create_hlr_db(pid=18419): Terminated: ok {rc=0} 06:38:05.899972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18421): Launched 06:38:06.205251 run osmo-hlr_10.42.42.2(pid=18422): Launched 06:38:06.320903 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:06.858694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18424): Launched 06:38:07.165188 run osmo-stp_10.42.42.5(pid=18425): Launched 06:38:07.281578 run osmo-msc_10.42.42.6: Starting osmo-msc 06:38:07.831556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18427): Launched 06:38:08.136588 run osmo-msc_10.42.42.6(pid=18428): Launched 06:38:08.307470 run osmo-stp_10.42.42.5(pid=18425): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18425)] 06:38:08.437627 run osmo-stp_10.42.42.5(pid=18425): stdout: | (launched: 2022-12-14_06:38:07.108441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:08.566832 run osmo-stp_10.42.42.5(pid=18425): stderr: | 20221214063807278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063807278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063807278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063807279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063807279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063807279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063807279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:08.694026 run osmo-stp_10.42.42.5(pid=18425): stdout: | (launched: 2022-12-14_06:38:07.108441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:08.815123 run osmo-stp_10.42.42.5(pid=18425): stderr: | 20221214063807278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063807278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063807278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063807279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063807279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063807279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063807279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:08.960392 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18425): Process ended prematurely: osmo-stp_10.42.42.5(pid=18425) [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18425)] [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:38:08.969400 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:38:08.995572 run osmo-hlr_10.42.42.2(pid=18422): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18422)] 06:38:09.042641 run osmo-hlr_10.42.42.2(pid=18422): stdout: | (launched: 2022-12-14_06:38:06.149331) 06:38:09.090943 run osmo-hlr_10.42.42.2(pid=18422): stderr: | 20221214063806321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063806321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063806321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063806322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063806322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063806322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063806334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063806342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063806342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063806342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:09.158617 run osmo-msc_10.42.42.6(pid=18428): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18428)] 06:38:09.205050 run osmo-msc_10.42.42.6(pid=18428): stdout: | (launched: 2022-12-14_06:38:08.080877) 06:38:09.253356 run osmo-msc_10.42.42.6(pid=18428): stderr: | 20221214063808349 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063808349 DLGLOBAL DEBUG validating counter group 0x7f213fa95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063808349 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063808349 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063808349 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063808349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063808351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063808351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063808352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063808352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:38:09.302376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18421): Terminating (SIGTERM) 06:38:09.341588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18424): Terminating (SIGTERM) 06:38:09.380747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18427): Terminating (SIGTERM) 06:38:09.420152 --- ParallelTerminationStrategy: PID 18421 died... 06:38:09.439326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18421): Terminated: ok {rc=0} 06:38:09.482521 --- ParallelTerminationStrategy: PID 18424 died... 06:38:09.501628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18424): Terminated: ok {rc=0} 06:38:09.544851 --- ParallelTerminationStrategy: PID 18427 died... 06:38:09.563873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18427): Terminated: ok {rc=0} 06:38:09.648084 bus /sierra_3: Setting Powered False 06:38:10.744758 bus /sierra_3: Setting Powered False 06:38:11.857752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:38:13.103425 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:38:13.110274 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:38:13.141539 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 06:38:13.168737 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 06:38:13.223378 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:38:13.255274 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 06:38:13.282192 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 06:38:13.830943 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 06:38:13.885580 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:13.897606 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:38:13.947217 tst mo_mt_call.py: using LAC 39090 06:38:14.074299 tst mo_mt_call.py: using RAC 75 06:38:14.202413 tst mo_mt_call.py: using CellId 39090 06:38:14.331748 tst mo_mt_call.py: using BVCI 39091 06:38:14.450707 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:14.462788 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:14.474439 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:14.486088 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:14.497990 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:14.509877 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:38:14.628561 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:38:14.746440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:15.220436 run create_hlr_db(pid=18433): Launched 06:38:15.338134 bus /sierra_2: Setting Powered False 06:38:16.397961 run create_hlr_db(pid=18433): Terminated: ok {rc=0} 06:38:16.839290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Launched 06:38:17.217670 run osmo-hlr_10.42.42.2(pid=18436): Launched 06:38:17.343146 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:17.912447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Launched 06:38:18.238404 run osmo-stp_10.42.42.5(pid=18439): Launched 06:38:18.362210 run osmo-msc_10.42.42.6: Starting osmo-msc 06:38:18.951777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18441): Launched 06:38:19.278168 run osmo-msc_10.42.42.6(pid=18442): Launched 06:38:19.458808 run osmo-stp_10.42.42.5(pid=18439): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] 06:38:19.595637 run osmo-stp_10.42.42.5(pid=18439): stdout: | (launched: 2022-12-14_06:38:18.179216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:19.733077 run osmo-stp_10.42.42.5(pid=18439): stderr: | 20221214063818371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063818371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063818371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063818371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063818372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063818372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063818372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:19.869277 run osmo-stp_10.42.42.5(pid=18439): stdout: | (launched: 2022-12-14_06:38:18.179216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:19.999061 run osmo-stp_10.42.42.5(pid=18439): stderr: | 20221214063818371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063818371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063818371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063818371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063818372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063818372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063818372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:20.154176 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18439): Process ended prematurely: osmo-stp_10.42.42.5(pid=18439) [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 06:38:20.163791 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:38:20.191576 run osmo-hlr_10.42.42.2(pid=18436): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18436)] 06:38:20.241142 run osmo-hlr_10.42.42.2(pid=18436): stdout: | (launched: 2022-12-14_06:38:17.154704) 06:38:20.292250 run osmo-hlr_10.42.42.2(pid=18436): stderr: | 20221214063817357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063817357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063817357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063817357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063817357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063817357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063817370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063817378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063817378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063817378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:20.363851 run osmo-msc_10.42.42.6(pid=18442): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18442)] 06:38:20.413076 run osmo-msc_10.42.42.6(pid=18442): stdout: | (launched: 2022-12-14_06:38:19.218502) 06:38:20.463841 run osmo-msc_10.42.42.6(pid=18442): stderr: | 20221214063819540 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063819540 DLGLOBAL DEBUG validating counter group 0x7f94b7e18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063819540 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063819540 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063819540 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063819540 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063819542 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063819542 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063819543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063819543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:38:20.515105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Terminating (SIGTERM) 06:38:20.556073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Terminating (SIGTERM) 06:38:20.597143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18441): Terminating (SIGTERM) 06:38:20.639182 --- ParallelTerminationStrategy: PID 18435 died... 06:38:20.659240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Terminated: ok {rc=0} 06:38:20.705118 --- ParallelTerminationStrategy: PID 18438 died... 06:38:20.724578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Terminated: ok {rc=0} 06:38:20.770278 --- ParallelTerminationStrategy: PID 18441 died... 06:38:20.790037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18441): Terminated: ok {rc=0} 06:38:20.877267 bus /sierra_3: Setting Powered False 06:38:21.974678 bus /sierra_3: Setting Powered False 06:38:23.090478 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 06:38:24.236163 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:24.248688 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:38:24.300132 tst mo_mt_call_osmux.py: using LAC 39091 06:38:24.429198 tst mo_mt_call_osmux.py: using RAC 76 06:38:24.556402 tst mo_mt_call_osmux.py: using CellId 39091 06:38:24.685615 tst mo_mt_call_osmux.py: using BVCI 39092 06:38:24.798202 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:24.809886 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:24.821405 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:24.832608 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:24.844573 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:38:24.856413 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:38:24.979955 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:38:25.100710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:25.606865 run create_hlr_db(pid=18444): Launched 06:38:25.739765 bus /sierra_2: Setting Powered False 06:38:26.804560 run create_hlr_db(pid=18444): Terminated: ok {rc=0} 06:38:27.241476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18446): Launched 06:38:27.570077 run osmo-hlr_10.42.42.2(pid=18447): Launched 06:38:27.694438 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:28.257447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18449): Launched 06:38:28.585133 run osmo-stp_10.42.42.5(pid=18450): Launched 06:38:28.709098 run osmo-msc_10.42.42.6: Starting osmo-msc 06:38:29.306603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18452): Launched 06:38:29.634768 run osmo-msc_10.42.42.6(pid=18453): Launched 06:38:29.815589 run osmo-stp_10.42.42.5(pid=18450): ERR: Terminated: ERROR {rc=1} [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18450)] 06:38:29.953676 run osmo-stp_10.42.42.5(pid=18450): stdout: | (launched: 2022-12-14_06:38:28.525261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:30.091327 run osmo-stp_10.42.42.5(pid=18450): stderr: | 20221214063828717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063828717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063828717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063828718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063828718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063828718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063828718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:30.227028 run osmo-stp_10.42.42.5(pid=18450): stdout: | (launched: 2022-12-14_06:38:28.525261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:30.356926 run osmo-stp_10.42.42.5(pid=18450): stderr: | 20221214063828717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063828717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063828717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063828718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063828718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063828718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063828718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:30.512559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18450): Process ended prematurely: osmo-stp_10.42.42.5(pid=18450) [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18450)] [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 06:38:30.522246 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:38:30.549947 run osmo-hlr_10.42.42.2(pid=18447): ERR: Terminated: ERROR {rc=237} [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18447)] 06:38:30.599534 run osmo-hlr_10.42.42.2(pid=18447): stdout: | (launched: 2022-12-14_06:38:27.510282) 06:38:30.650735 run osmo-hlr_10.42.42.2(pid=18447): stderr: | 20221214063827705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063827705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063827705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063827705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063827705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063827705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063827717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063827725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063827726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063827726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:30.722460 run osmo-msc_10.42.42.6(pid=18453): ERR: Terminated: ERROR {rc=2} [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18453)] 06:38:30.771787 run osmo-msc_10.42.42.6(pid=18453): stdout: | (launched: 2022-12-14_06:38:29.575044) 06:38:30.822601 run osmo-msc_10.42.42.6(pid=18453): stderr: | 20221214063829894 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063829894 DLGLOBAL DEBUG validating counter group 0x7f99d47cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063829894 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063829894 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063829894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063829895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063829896 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063829897 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063829897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063829897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:38:30.878228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18446): Terminating (SIGTERM) 06:38:30.927190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18449): Terminating (SIGTERM) 06:38:30.970835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18452): Terminating (SIGTERM) 06:38:31.016029 --- ParallelTerminationStrategy: PID 18446 died... 06:38:31.035770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18446): Terminated: ok {rc=0} 06:38:31.082099 --- ParallelTerminationStrategy: PID 18449 died... 06:38:31.101981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18449): Terminated: ok {rc=0} 06:38:31.148221 --- ParallelTerminationStrategy: PID 18452 died... 06:38:31.168218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18452): Terminated: ok {rc=0} 06:38:31.261280 bus /sierra_3: Setting Powered False 06:38:32.370334 bus /sierra_3: Setting Powered False 06:38:33.484333 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 emergency:nanobts+band-900 --------------------------------------------------------------------- 06:38:34.739296 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:38:34.745039 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:38:34.777669 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:38:34.804714 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 06:38:34.889377 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:38:34.920860 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:38:34.947647 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 06:38:35.536856 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2400 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 06:38:35.543082 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:35.554117 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 06:38:35.601282 tst emergency_mo_mt_call.py: using LAC 39092 06:38:35.718349 tst emergency_mo_mt_call.py: using RAC 77 06:38:35.835971 tst emergency_mo_mt_call.py: using CellId 39092 06:38:35.952362 tst emergency_mo_mt_call.py: using BVCI 39093 06:38:36.060802 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:36.071630 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:36.082193 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:36.092683 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:36.103480 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:36.114324 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:36.232301 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:36.347652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:36.813415 run create_hlr_db(pid=18458): Launched 06:38:36.927208 bus /sierra_2: Setting Powered False 06:38:37.987569 run create_hlr_db(pid=18458): Terminated: ok {rc=0} 06:38:38.426921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18460): Launched 06:38:38.748321 run osmo-hlr_10.42.42.2(pid=18461): Launched 06:38:38.870722 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:39.426682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18463): Launched 06:38:39.747496 run osmo-stp_10.42.42.5(pid=18464): Launched 06:38:39.880296 tst emergency_mo_mt_call.py: using MSISDN 8541 06:38:40.046412 run osmo-msc_10.42.42.6: Starting osmo-msc 06:38:40.624527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18466): Launched 06:38:40.945642 run osmo-msc_10.42.42.6(pid=18467): Launched 06:38:41.124682 run osmo-stp_10.42.42.5(pid=18464): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18464)] 06:38:41.263189 run osmo-stp_10.42.42.5(pid=18464): stdout: | (launched: 2022-12-14_06:38:39.688606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:41.398513 run osmo-stp_10.42.42.5(pid=18464): stderr: | 20221214063839878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063839878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063839878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063839879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063839879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063839879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063839879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:41.532808 run osmo-stp_10.42.42.5(pid=18464): stdout: | (launched: 2022-12-14_06:38:39.688606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:41.660250 run osmo-stp_10.42.42.5(pid=18464): stderr: | 20221214063839878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063839878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063839878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063839879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063839879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063839879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063839879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:41.812749 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18464): Process ended prematurely: osmo-stp_10.42.42.5(pid=18464) [trial-2400↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18464)] [trial-2400↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 06:38:41.821773 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 06:38:41.848852 run osmo-hlr_10.42.42.2(pid=18461): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18461)] 06:38:41.898891 run osmo-hlr_10.42.42.2(pid=18461): stdout: | (launched: 2022-12-14_06:38:38.689246) 06:38:41.950479 run osmo-hlr_10.42.42.2(pid=18461): stderr: | 20221214063838885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063838885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063838885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063838885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063838885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063838885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063838899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063838907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063838907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063838907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:42.021804 run osmo-msc_10.42.42.6(pid=18467): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18467)] 06:38:42.070930 run osmo-msc_10.42.42.6(pid=18467): stdout: | (launched: 2022-12-14_06:38:40.886628) 06:38:42.122159 run osmo-msc_10.42.42.6(pid=18467): stderr: | 20221214063841206 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063841206 DLGLOBAL DEBUG validating counter group 0x7f2510338c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063841206 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063841206 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063841206 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063841207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063841208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063841209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063841209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063841209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:38:42.173423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18460): Terminating (SIGTERM) 06:38:42.214100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18463): Terminating (SIGTERM) 06:38:42.254957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18466): Terminating (SIGTERM) 06:38:42.295995 --- ParallelTerminationStrategy: PID 18460 died... 06:38:42.315763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18460): Terminated: ok {rc=0} 06:38:42.361142 --- ParallelTerminationStrategy: PID 18463 died... 06:38:42.380182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18463): Terminated: ok {rc=0} 06:38:42.425467 --- ParallelTerminationStrategy: PID 18466 died... 06:38:42.444588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18466): Terminated: ok {rc=0} 06:38:42.530404 bus /sierra_3: Setting Powered False 06:38:43.627323 bus /sierra_3: Setting Powered False 06:38:44.741002 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 06:38:45.830454 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:45.842951 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 06:38:45.895089 tst emergency_preemptive_call.py: using LAC 39093 06:38:46.027883 tst emergency_preemptive_call.py: using RAC 78 06:38:46.159708 tst emergency_preemptive_call.py: using CellId 39093 06:38:46.281552 tst emergency_preemptive_call.py: using BVCI 39094 06:38:46.395099 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:46.407028 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:46.418749 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:46.430391 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:46.442954 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:38:46.455331 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:46.575936 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:46.693317 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:46.810704 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:46.926089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:47.423858 run create_hlr_db(pid=18469): Launched 06:38:47.554970 bus /sierra_2: Setting Powered False 06:38:48.618416 run create_hlr_db(pid=18469): Terminated: ok {rc=0} 06:38:49.066103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18471): Launched 06:38:49.388297 run osmo-hlr_10.42.42.2(pid=18472): Launched 06:38:49.510084 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:50.062900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18474): Launched 06:38:50.383468 run osmo-stp_10.42.42.5(pid=18475): Launched 06:38:50.513692 tst emergency_preemptive_call.py: using MSISDN 8542 06:38:50.678060 run osmo-msc_10.42.42.6: Starting osmo-msc 06:38:51.253994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18477): Launched 06:38:51.574240 run osmo-msc_10.42.42.6(pid=18478): Launched 06:38:51.754291 run osmo-stp_10.42.42.5(pid=18475): ERR: Terminated: ERROR {rc=1} [trial-2400↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18475)] 06:38:51.890722 run osmo-stp_10.42.42.5(pid=18475): stdout: | (launched: 2022-12-14_06:38:50.324706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:52.028098 run osmo-stp_10.42.42.5(pid=18475): stderr: | 20221214063850512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063850512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063850513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063850513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063850514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063850514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063850514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:52.162131 run osmo-stp_10.42.42.5(pid=18475): stdout: | (launched: 2022-12-14_06:38:50.324706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:52.290130 run osmo-stp_10.42.42.5(pid=18475): stderr: | 20221214063850512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063850512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063850513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063850513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063850514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063850514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063850514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:52.442862 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18475): Process ended prematurely: osmo-stp_10.42.42.5(pid=18475) [trial-2400↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18475)] [trial-2400↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 06:38:52.451882 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 06:38:52.479151 run osmo-hlr_10.42.42.2(pid=18472): ERR: Terminated: ERROR {rc=237} [trial-2400↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18472)] 06:38:52.528201 run osmo-hlr_10.42.42.2(pid=18472): stdout: | (launched: 2022-12-14_06:38:49.329480) 06:38:52.579326 run osmo-hlr_10.42.42.2(pid=18472): stderr: | 20221214063849525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063849525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063849526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063849526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063849526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063849526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063849541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063849549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063849549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063849549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:52.650663 run osmo-msc_10.42.42.6(pid=18478): ERR: Terminated: ERROR {rc=2} [trial-2400↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18478)] 06:38:52.699769 run osmo-msc_10.42.42.6(pid=18478): stdout: | (launched: 2022-12-14_06:38:51.515449) 06:38:52.750611 run osmo-msc_10.42.42.6(pid=18478): stderr: | 20221214063851833 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214063851833 DLGLOBAL DEBUG validating counter group 0x7ff402b13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214063851833 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214063851833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214063851834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214063851834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214063851835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214063851836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214063851836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214063851836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:38:52.801742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18471): Terminating (SIGTERM) 06:38:52.842941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18474): Terminating (SIGTERM) 06:38:52.884685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18477): Terminating (SIGTERM) 06:38:52.926743 --- ParallelTerminationStrategy: PID 18471 died... 06:38:52.946672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18471): Terminated: ok {rc=0} 06:38:52.992170 --- ParallelTerminationStrategy: PID 18474 died... 06:38:53.011575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18474): Terminated: ok {rc=0} 06:38:53.056836 --- ParallelTerminationStrategy: PID 18477 died... 06:38:53.076584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18477): Terminated: ok {rc=0} 06:38:53.162937 bus /sierra_9: Setting Powered False 06:38:54.261922 bus /sierra_9: Setting Powered False 06:38:55.377039 bus /sierra_8: Setting Powered False 06:38:56.474240 bus /sierra_8: Setting Powered False 06:38:57.590926 bus /sierra_3: Setting Powered False 06:38:58.688426 bus /sierra_3: Setting Powered False 06:38:59.802604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900 --------------------------------------------------------------------- 06:39:01.108727 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:39:01.114516 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:39:01.148633 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 06:39:01.190010 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 06:39:01.278884 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:39:01.330147 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 06:39:01.379276 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 06:39:02.012662 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 06:39:02.078882 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.091819 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:39:02.152414 tst cs_paging_gprs_active.py: using LAC 39094 06:39:02.319736 tst cs_paging_gprs_active.py: using RAC 79 06:39:02.475707 tst cs_paging_gprs_active.py: using CellId 39094 06:39:02.640560 tst cs_paging_gprs_active.py: using BVCI 39095 06:39:02.794298 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.810267 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.822777 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.839832 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.854050 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.868586 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.887213 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.905773 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:02.922511 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:03.089158 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:03.232125 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:39:03.499196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:03.908751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18673): Launched 06:39:04.287102 run iperf3-srv_10.42.42.10(pid=18724): Launched 06:39:04.446662 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:39:04.694109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:05.036307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18754): Launched 06:39:05.328901 run iperf3-srv_10.42.42.10(pid=18755): Launched 06:39:05.464287 tst cs_paging_gprs_active.py:38: start network... 06:39:05.680757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:06.177356 run create_hlr_db(pid=18756): Launched 06:39:06.334944 bus /sierra_2: Setting Powered False 06:39:07.399792 run create_hlr_db(pid=18756): Terminated: ok {rc=0} 06:39:07.851833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Launched 06:39:08.185089 run osmo-hlr_10.42.42.2(pid=18761): Launched 06:39:08.431739 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:09.136751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Launched 06:39:09.470394 run osmo-stp_10.42.42.5(pid=18764): Launched 06:39:09.727796 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:10.415806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18766): Launched 06:39:10.551339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:10.845726 run patchelf(pid=18767): Launched 06:39:11.039319 run osmo-stp_10.42.42.5(pid=18764): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] 06:39:11.177932 run osmo-stp_10.42.42.5(pid=18764): stdout: | (launched: 2022-12-14_06:39:09.411882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:11.316851 run osmo-stp_10.42.42.5(pid=18764): stderr: | 20221214063909735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063909736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063909736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063909736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063909741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063909741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063909741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:11.457386 run osmo-stp_10.42.42.5(pid=18764): stdout: | (launched: 2022-12-14_06:39:09.411882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:11.592673 run osmo-stp_10.42.42.5(pid=18764): stderr: | 20221214063909735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063909736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063909736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063909736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063909741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063909741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063909741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:11.750480 run patchelf(pid=18767): Terminating (SIGINT) 06:39:11.933353 run patchelf(pid=18767): Terminated: ok {rc=0} 06:39:12.066579 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18764): Process ended prematurely: osmo-stp_10.42.42.5(pid=18764) [trial-2400↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] [trial-2400↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 06:39:12.077472 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 06:39:12.106406 run osmo-hlr_10.42.42.2(pid=18761): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18761)] 06:39:12.157684 run osmo-hlr_10.42.42.2(pid=18761): stdout: | (launched: 2022-12-14_06:39:08.124836) 06:39:12.211405 run osmo-hlr_10.42.42.2(pid=18761): stderr: | 20221214063908461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063908461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063908462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063908462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063908462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063908462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063908480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063908488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063908489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063908489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:12.262876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18673): Terminating (SIGTERM) 06:39:12.305538 run iperf3-srv_10.42.42.10(pid=18724): Terminating (SIGTERM) 06:39:12.351168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18754): Terminating (SIGTERM) 06:39:12.395446 run iperf3-srv_10.42.42.10(pid=18755): Terminating (SIGTERM) 06:39:12.440807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Terminating (SIGTERM) 06:39:12.483926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Terminating (SIGTERM) 06:39:12.528458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18766): Terminating (SIGTERM) 06:39:12.573851 --- ParallelTerminationStrategy: PID 18673 died... 06:39:12.596231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18673): Terminated: ok {rc=0} 06:39:12.644468 --- ParallelTerminationStrategy: PID 18724 died... 06:39:12.664869 run iperf3-srv_10.42.42.10(pid=18724): Terminated {rc=256} 06:39:12.711097 --- ParallelTerminationStrategy: PID 18754 died... 06:39:12.732008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18754): Terminated: ok {rc=0} 06:39:12.779306 --- ParallelTerminationStrategy: PID 18755 died... 06:39:12.800253 run iperf3-srv_10.42.42.10(pid=18755): Terminated {rc=256} 06:39:12.846833 --- ParallelTerminationStrategy: PID 18760 died... 06:39:12.867652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Terminated: ok {rc=0} 06:39:12.914138 --- ParallelTerminationStrategy: PID 18763 died... 06:39:12.935527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Terminated: ok {rc=0} 06:39:12.983411 --- ParallelTerminationStrategy: PID 18766 died... 06:39:13.004471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18766): Terminated: ok {rc=0} 06:39:13.094959 bus /gobi_0: Setting Powered False 06:39:14.196736 bus /gobi_0: Setting Powered False 06:39:15.315622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 06:39:16.477934 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:16.490603 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:39:16.545814 tst iperf3.py: using LAC 39095 06:39:16.737176 tst iperf3.py: using RAC 80 06:39:16.902490 tst iperf3.py: using CellId 39095 06:39:17.088575 tst iperf3.py: using BVCI 39096 06:39:17.256355 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.268448 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.281616 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.294936 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.308675 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.322171 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.336447 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.351353 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:17.365894 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:17.543022 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:39:17.820731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:18.164184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18768): Launched 06:39:18.471160 run iperf3-srv_10.42.42.10(pid=18769): Launched 06:39:18.611718 tst iperf3.py:8: start network... 06:39:18.843353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:19.376282 run create_hlr_db(pid=18770): Launched 06:39:19.546808 bus /gobi_6: Setting Powered False 06:39:20.614847 run create_hlr_db(pid=18770): Terminated: ok {rc=0} 06:39:21.095615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18772): Launched 06:39:21.452289 run osmo-hlr_10.42.42.2(pid=18773): Launched 06:39:21.709548 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:22.402724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18775): Launched 06:39:22.758724 run osmo-stp_10.42.42.5(pid=18776): Launched 06:39:23.023100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:23.686308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18778): Launched 06:39:23.829791 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:24.124149 run patchelf(pid=18779): Launched 06:39:24.328146 run osmo-stp_10.42.42.5(pid=18776): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18776)] 06:39:24.475971 run osmo-stp_10.42.42.5(pid=18776): stdout: | (launched: 2022-12-14_06:39:22.696443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:24.624664 run osmo-stp_10.42.42.5(pid=18776): stderr: | 20221214063922996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063922996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063922996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063922997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063922997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063922997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063922997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:24.773343 run osmo-stp_10.42.42.5(pid=18776): stdout: | (launched: 2022-12-14_06:39:22.696443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:24.915746 run osmo-stp_10.42.42.5(pid=18776): stderr: | 20221214063922996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063922996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063922996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063922997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063922997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063922997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063922997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:25.087143 run patchelf(pid=18779): Terminating (SIGINT) 06:39:25.283823 run patchelf(pid=18779): Terminated: ok {rc=0} 06:39:25.418461 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18776): Process ended prematurely: osmo-stp_10.42.42.5(pid=18776) [trial-2400↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18776)] [trial-2400↪gprs:nanobts+band-900↪iperf3.py:8] 06:39:25.428801 tst iperf3.py:8: Test FAILED (9.0 sec) 06:39:25.457596 run osmo-hlr_10.42.42.2(pid=18773): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18773)] 06:39:25.507809 run osmo-hlr_10.42.42.2(pid=18773): stdout: | (launched: 2022-12-14_06:39:21.389803) 06:39:25.560089 run osmo-hlr_10.42.42.2(pid=18773): stderr: | 20221214063921698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063921698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063921698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063921698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063921698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063921698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063921711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063921728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063921728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063921728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:25.612211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18768): Terminating (SIGTERM) 06:39:25.654623 run iperf3-srv_10.42.42.10(pid=18769): Terminating (SIGTERM) 06:39:25.698627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18772): Terminating (SIGTERM) 06:39:25.741061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18775): Terminating (SIGTERM) 06:39:25.783243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18778): Terminating (SIGTERM) 06:39:25.825465 --- ParallelTerminationStrategy: PID 18768 died... 06:39:25.845643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18768): Terminated: ok {rc=0} 06:39:25.892621 --- ParallelTerminationStrategy: PID 18769 died... 06:39:25.912816 run iperf3-srv_10.42.42.10(pid=18769): Terminated {rc=256} 06:39:25.959286 --- ParallelTerminationStrategy: PID 18772 died... 06:39:25.979086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18772): Terminated: ok {rc=0} 06:39:26.025424 --- ParallelTerminationStrategy: PID 18775 died... 06:39:26.045357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18775): Terminated: ok {rc=0} 06:39:26.091770 --- ParallelTerminationStrategy: PID 18778 died... 06:39:26.111647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18778): Terminated: ok {rc=0} 06:39:26.200887 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 06:39:27.352425 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.364337 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:39:27.412644 tst iperf3m4.py: using LAC 39096 06:39:27.544641 tst iperf3m4.py: using RAC 81 06:39:27.676280 tst iperf3m4.py: using CellId 39096 06:39:27.806323 tst iperf3m4.py: using BVCI 39097 06:39:27.929160 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.940439 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.951671 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.962737 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.973753 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.984748 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:27.996124 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:28.007119 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:28.018323 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:28.136735 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:28.259818 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:28.378825 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:28.499818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:39:28.727473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:29.065183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Launched 06:39:29.357108 run iperf3-srv_10.42.42.10(pid=18782): Launched 06:39:29.483656 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:39:29.709978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:30.047669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Launched 06:39:30.338818 run iperf3-srv_10.42.42.10(pid=18784): Launched 06:39:30.465317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:39:30.691042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:31.047642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18785): Launched 06:39:31.355191 run iperf3-srv_10.42.42.10(pid=18786): Launched 06:39:31.495412 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:39:31.726111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:32.072553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18787): Launched 06:39:32.375835 run iperf3-srv_10.42.42.10(pid=18788): Launched 06:39:32.503030 tst iperf3m4.py:8: start network... 06:39:32.728791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:33.248609 run create_hlr_db(pid=18789): Launched 06:39:33.383509 bus /gobi_6: Setting Powered False 06:39:34.448832 run create_hlr_db(pid=18789): Terminated: ok {rc=0} 06:39:34.894859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18791): Launched 06:39:35.210917 run osmo-hlr_10.42.42.2(pid=18792): Launched 06:39:35.333132 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:35.889307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18794): Launched 06:39:36.207655 run osmo-stp_10.42.42.5(pid=18795): Launched 06:39:36.327479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:36.869389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18797): Launched 06:39:36.989533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:37.255129 run patchelf(pid=18798): Launched 06:39:37.429276 run osmo-stp_10.42.42.5(pid=18795): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18795)] 06:39:37.561742 run osmo-stp_10.42.42.5(pid=18795): stdout: | (launched: 2022-12-14_06:39:36.149097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:37.695703 run osmo-stp_10.42.42.5(pid=18795): stderr: | 20221214063936318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063936318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063936318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063936319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063936319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063936319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063936319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:37.830049 run osmo-stp_10.42.42.5(pid=18795): stdout: | (launched: 2022-12-14_06:39:36.149097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:37.958072 run osmo-stp_10.42.42.5(pid=18795): stderr: | 20221214063936318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063936318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063936318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063936319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063936319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063936319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063936319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:38.110351 run patchelf(pid=18798): Terminating (SIGINT) 06:39:38.286526 run patchelf(pid=18798): Terminated: ok {rc=0} 06:39:38.413689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18795): Process ended prematurely: osmo-stp_10.42.42.5(pid=18795) [trial-2400↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18795)] [trial-2400↪gprs:nanobts+band-900↪iperf3m4.py:8] 06:39:38.423284 tst iperf3m4.py:8: Test FAILED (11.1 sec) 06:39:38.450733 run osmo-hlr_10.42.42.2(pid=18792): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18792)] 06:39:38.499184 run osmo-hlr_10.42.42.2(pid=18792): stdout: | (launched: 2022-12-14_06:39:35.152018) 06:39:38.548641 run osmo-hlr_10.42.42.2(pid=18792): stderr: | 20221214063935329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063935329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063935329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063935329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063935329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063935329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063935341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063935349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063935350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063935350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:38.598310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Terminating (SIGTERM) 06:39:38.638475 run iperf3-srv_10.42.42.10(pid=18782): Terminating (SIGTERM) 06:39:38.678636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Terminating (SIGTERM) 06:39:38.718624 run iperf3-srv_10.42.42.10(pid=18784): Terminating (SIGTERM) 06:39:38.758478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18785): Terminating (SIGTERM) 06:39:38.798477 run iperf3-srv_10.42.42.10(pid=18786): Terminating (SIGTERM) 06:39:38.838468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18787): Terminating (SIGTERM) 06:39:38.878216 run iperf3-srv_10.42.42.10(pid=18788): Terminating (SIGTERM) 06:39:38.918095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18791): Terminating (SIGTERM) 06:39:38.957917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18794): Terminating (SIGTERM) 06:39:38.997842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18797): Terminating (SIGTERM) 06:39:39.038099 --- ParallelTerminationStrategy: PID 18781 died... 06:39:39.057619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Terminated: ok {rc=0} 06:39:39.102004 --- ParallelTerminationStrategy: PID 18782 died... 06:39:39.120876 run iperf3-srv_10.42.42.10(pid=18782): Terminated {rc=256} 06:39:39.165297 --- ParallelTerminationStrategy: PID 18783 died... 06:39:39.184085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Terminated: ok {rc=0} 06:39:39.228227 --- ParallelTerminationStrategy: PID 18784 died... 06:39:39.247148 run iperf3-srv_10.42.42.10(pid=18784): Terminated {rc=256} 06:39:39.291007 --- ParallelTerminationStrategy: PID 18785 died... 06:39:39.310102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18785): Terminated: ok {rc=0} 06:39:39.354077 --- ParallelTerminationStrategy: PID 18786 died... 06:39:39.373018 run iperf3-srv_10.42.42.10(pid=18786): Terminated {rc=256} 06:39:39.417013 --- ParallelTerminationStrategy: PID 18787 died... 06:39:39.435962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18787): Terminated: ok {rc=0} 06:39:39.479825 --- ParallelTerminationStrategy: PID 18788 died... 06:39:39.498738 run iperf3-srv_10.42.42.10(pid=18788): Terminated {rc=256} 06:39:39.542591 --- ParallelTerminationStrategy: PID 18791 died... 06:39:39.561694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18791): Terminated: ok {rc=0} 06:39:39.605877 --- ParallelTerminationStrategy: PID 18794 died... 06:39:39.624804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18794): Terminated: ok {rc=0} 06:39:39.668916 --- ParallelTerminationStrategy: PID 18797 died... 06:39:39.688149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18797): Terminated: ok {rc=0} 06:39:39.772202 bus /gobi_4: Setting Powered False 06:39:40.866147 bus /gobi_4: Setting Powered False 06:39:41.977703 bus /gobi_1: Setting Powered False 06:39:43.076090 bus /gobi_1: Setting Powered False 06:39:44.191494 bus /gobi_0: Setting Powered False 06:39:45.288652 bus /gobi_0: Setting Powered False 06:39:46.407450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900 ping.py ---------------------------------------------- 06:39:47.511917 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:47.524031 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:39:47.573347 tst ping.py: using LAC 39097 06:39:47.695432 tst ping.py: using RAC 82 06:39:47.817931 tst ping.py: using CellId 39097 06:39:47.941561 tst ping.py: using BVCI 39098 06:39:48.062950 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.074429 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.085869 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.096893 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.108057 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.119191 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.130446 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:48.141543 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:48.261720 tst ping.py:19: start network... 06:39:48.483879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:48.992577 run create_hlr_db(pid=18799): Launched 06:39:49.126089 bus /gobi_6: Setting Powered False 06:39:50.191116 run create_hlr_db(pid=18799): Terminated: ok {rc=0} 06:39:50.629887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18801): Launched 06:39:50.938418 run osmo-hlr_10.42.42.2(pid=18802): Launched 06:39:51.055574 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:51.604277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18804): Launched 06:39:51.934048 run osmo-stp_10.42.42.5(pid=18805): Launched 06:39:52.060453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:52.628658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18807): Launched 06:39:52.755583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:53.034830 run patchelf(pid=18808): Launched 06:39:53.216930 run osmo-stp_10.42.42.5(pid=18805): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18805)] 06:39:53.355964 run osmo-stp_10.42.42.5(pid=18805): stdout: | (launched: 2022-12-14_06:39:51.873570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:53.496579 run osmo-stp_10.42.42.5(pid=18805): stderr: | 20221214063952067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063952067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063952067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063952068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063952070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063952070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063952070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:53.637343 run osmo-stp_10.42.42.5(pid=18805): stdout: | (launched: 2022-12-14_06:39:51.873570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:53.771974 run osmo-stp_10.42.42.5(pid=18805): stderr: | 20221214063952067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214063952067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214063952067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214063952068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214063952070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214063952070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214063952070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:53.931874 run patchelf(pid=18808): Terminating (SIGINT) 06:39:54.115759 run patchelf(pid=18808): Terminated: ok {rc=0} 06:39:54.247706 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18805): Process ended prematurely: osmo-stp_10.42.42.5(pid=18805) [trial-2400↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18805)] [trial-2400↪gprs:nanobts+band-900↪ping.py:22] 06:39:54.257504 tst ping.py:22: Test FAILED (6.7 sec) 06:39:54.285775 run osmo-hlr_10.42.42.2(pid=18802): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18802)] 06:39:54.336214 run osmo-hlr_10.42.42.2(pid=18802): stdout: | (launched: 2022-12-14_06:39:50.881151) 06:39:54.388440 run osmo-hlr_10.42.42.2(pid=18802): stderr: | 20221214063951062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063951062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063951062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063951062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063951062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063951062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063951074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063951084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063951084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063951084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:54.441079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18801): Terminating (SIGTERM) 06:39:54.483026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18804): Terminating (SIGTERM) 06:39:54.526353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18807): Terminating (SIGTERM) 06:39:54.568651 --- ParallelTerminationStrategy: PID 18801 died... 06:39:54.589073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18801): Terminated: ok {rc=0} 06:39:54.635664 --- ParallelTerminationStrategy: PID 18804 died... 06:39:54.655395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18804): Terminated: ok {rc=0} 06:39:54.701911 --- ParallelTerminationStrategy: PID 18807 died... 06:39:54.721781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18807): Terminated: ok {rc=0} 06:39:54.810007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 06:39:55.896668 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:55.908552 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:39:55.958279 tst ping_idle_ping.py: using LAC 39098 06:39:56.087771 tst ping_idle_ping.py: using RAC 83 06:39:56.217539 tst ping_idle_ping.py: using CellId 39098 06:39:56.350471 tst ping_idle_ping.py: using BVCI 39099 06:39:56.470560 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.481991 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.493239 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.504297 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.515463 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.526641 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.537950 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:39:56.549159 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:39:56.665376 tst ping_idle_ping.py:24: start network... 06:39:56.874062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:57.355553 run create_hlr_db(pid=18810): Launched 06:39:57.473783 bus /gobi_6: Setting Powered False 06:39:58.535143 run create_hlr_db(pid=18810): Terminated: ok {rc=0} 06:39:58.985625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Launched 06:39:59.314654 run osmo-hlr_10.42.42.2(pid=18813): Launched 06:39:59.440422 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:00.010166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Launched 06:40:00.342621 run osmo-stp_10.42.42.5(pid=18816): Launched 06:40:00.470912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:01.044738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18818): Launched 06:40:01.179901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:01.490340 run patchelf(pid=18819): Launched 06:40:01.691991 run osmo-stp_10.42.42.5(pid=18816): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] 06:40:01.827202 run osmo-stp_10.42.42.5(pid=18816): stdout: | (launched: 2022-12-14_06:40:00.281896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:02.007330 run osmo-stp_10.42.42.5(pid=18816): stderr: | 20221214064000483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064000483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064000483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064000483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064000484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064000484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064000484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:02.144250 run osmo-stp_10.42.42.5(pid=18816): stdout: | (launched: 2022-12-14_06:40:00.281896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:02.275705 run osmo-stp_10.42.42.5(pid=18816): stderr: | 20221214064000483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064000483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064000483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064000483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064000484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064000484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064000484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:02.435260 run patchelf(pid=18819): Terminating (SIGINT) 06:40:02.619639 run patchelf(pid=18819): Terminated: ok {rc=0} 06:40:02.752528 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18816): Process ended prematurely: osmo-stp_10.42.42.5(pid=18816) [trial-2400↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] [trial-2400↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 06:40:02.762382 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 06:40:02.790874 run osmo-hlr_10.42.42.2(pid=18813): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18813)] 06:40:02.841210 run osmo-hlr_10.42.42.2(pid=18813): stdout: | (launched: 2022-12-14_06:39:59.253696) 06:40:02.893341 run osmo-hlr_10.42.42.2(pid=18813): stderr: | 20221214063959456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214063959456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214063959456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214063959456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214063959457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214063959457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214063959472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214063959480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214063959481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214063959481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:02.945681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Terminating (SIGTERM) 06:40:02.987892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Terminating (SIGTERM) 06:40:03.030474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18818): Terminating (SIGTERM) 06:40:03.073060 --- ParallelTerminationStrategy: PID 18812 died... 06:40:03.093464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Terminated: ok {rc=0} 06:40:03.139997 --- ParallelTerminationStrategy: PID 18815 died... 06:40:03.160006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Terminated: ok {rc=0} 06:40:03.206332 --- ParallelTerminationStrategy: PID 18818 died... 06:40:03.226072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18818): Terminated: ok {rc=0} 06:40:03.313872 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 06:40:04.617827 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:40:04.624400 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:40:04.657446 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:40:04.697604 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:40:04.786048 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:40:04.818911 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:40:04.858020 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:40:05.460597 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:40:05.514245 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:05.525737 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:40:05.574984 tst cs_paging_gprs_active.py: using LAC 39099 06:40:05.709444 tst cs_paging_gprs_active.py: using RAC 84 06:40:05.839099 tst cs_paging_gprs_active.py: using CellId 39099 06:40:05.968703 tst cs_paging_gprs_active.py: using BVCI 39100 06:40:06.089613 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.101569 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.112717 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.123912 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.135010 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.146273 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.157552 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.168588 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:06.179910 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:06.298791 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:06.419353 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:40:06.646658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:06.983955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18827): Launched 06:40:07.276564 run iperf3-srv_10.42.42.10(pid=18828): Launched 06:40:07.403419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:40:07.630168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:07.966882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18829): Launched 06:40:08.259028 run iperf3-srv_10.42.42.10(pid=18830): Launched 06:40:08.385247 tst cs_paging_gprs_active.py:38: start network... 06:40:08.611367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:09.130921 run create_hlr_db(pid=18831): Launched 06:40:09.265638 bus /gobi_6: Setting Powered False 06:40:10.331141 run create_hlr_db(pid=18831): Terminated: ok {rc=0} 06:40:10.779072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18833): Launched 06:40:11.095031 run osmo-hlr_10.42.42.2(pid=18834): Launched 06:40:11.214535 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:11.758006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18836): Launched 06:40:12.071815 run osmo-stp_10.42.42.5(pid=18837): Launched 06:40:12.191484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:12.732241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18839): Launched 06:40:12.852495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:13.118898 run patchelf(pid=18840): Launched 06:40:13.294738 run osmo-stp_10.42.42.5(pid=18837): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18837)] 06:40:13.427209 run osmo-stp_10.42.42.5(pid=18837): stdout: | (launched: 2022-12-14_06:40:12.013848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:13.561664 run osmo-stp_10.42.42.5(pid=18837): stderr: | 20221214064012188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064012188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064012188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064012188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064012191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064012191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064012191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:13.696254 run osmo-stp_10.42.42.5(pid=18837): stdout: | (launched: 2022-12-14_06:40:12.013848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:13.824502 run osmo-stp_10.42.42.5(pid=18837): stderr: | 20221214064012188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064012188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064012188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064012188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064012191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064012191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064012191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:13.976544 run patchelf(pid=18840): Terminating (SIGINT) 06:40:14.152712 run patchelf(pid=18840): Terminated: ok {rc=0} 06:40:14.280584 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18837): Process ended prematurely: osmo-stp_10.42.42.5(pid=18837) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18837)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:40:14.290285 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:40:14.317297 run osmo-hlr_10.42.42.2(pid=18834): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18834)] 06:40:14.365134 run osmo-hlr_10.42.42.2(pid=18834): stdout: | (launched: 2022-12-14_06:40:11.036930) 06:40:14.414066 run osmo-hlr_10.42.42.2(pid=18834): stderr: | 20221214064011217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064011217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064011217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064011218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064011218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064011218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064011230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064011239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064011239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064011239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:14.463461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18827): Terminating (SIGTERM) 06:40:14.503274 run iperf3-srv_10.42.42.10(pid=18828): Terminating (SIGTERM) 06:40:14.542882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18829): Terminating (SIGTERM) 06:40:14.582447 run iperf3-srv_10.42.42.10(pid=18830): Terminating (SIGTERM) 06:40:14.622031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18833): Terminating (SIGTERM) 06:40:14.661563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18836): Terminating (SIGTERM) 06:40:14.701158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18839): Terminating (SIGTERM) 06:40:14.741215 --- ParallelTerminationStrategy: PID 18827 died... 06:40:14.760521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18827): Terminated: ok {rc=0} 06:40:14.804474 --- ParallelTerminationStrategy: PID 18828 died... 06:40:14.823414 run iperf3-srv_10.42.42.10(pid=18828): Terminated {rc=256} 06:40:14.867011 --- ParallelTerminationStrategy: PID 18829 died... 06:40:14.885999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18829): Terminated: ok {rc=0} 06:40:14.929900 --- ParallelTerminationStrategy: PID 18830 died... 06:40:14.948481 run iperf3-srv_10.42.42.10(pid=18830): Terminated {rc=256} 06:40:14.992386 --- ParallelTerminationStrategy: PID 18833 died... 06:40:15.011375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18833): Terminated: ok {rc=0} 06:40:15.055379 --- ParallelTerminationStrategy: PID 18836 died... 06:40:15.074262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18836): Terminated: ok {rc=0} 06:40:15.118257 --- ParallelTerminationStrategy: PID 18839 died... 06:40:15.137251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18839): Terminated: ok {rc=0} 06:40:15.223208 bus /gobi_0: Setting Powered False 06:40:16.319308 bus /gobi_0: Setting Powered False 06:40:17.431347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:40:18.581736 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:18.593890 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:40:18.647672 tst iperf3.py: using LAC 39100 06:40:18.780707 tst iperf3.py: using RAC 85 06:40:18.911511 tst iperf3.py: using CellId 39100 06:40:19.044595 tst iperf3.py: using BVCI 39101 06:40:19.167746 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.179280 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.190580 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.201909 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.213106 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.224281 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.235713 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.246857 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:19.258319 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:19.378237 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:40:19.606165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:19.945315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18841): Launched 06:40:20.238991 run iperf3-srv_10.42.42.10(pid=18842): Launched 06:40:20.364780 tst iperf3.py:8: start network... 06:40:20.591917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:21.112059 run create_hlr_db(pid=18843): Launched 06:40:21.248071 bus /gobi_6: Setting Powered False 06:40:22.312715 run create_hlr_db(pid=18843): Terminated: ok {rc=0} 06:40:22.758516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18845): Launched 06:40:23.073340 run osmo-hlr_10.42.42.2(pid=18846): Launched 06:40:23.193197 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:23.746774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18848): Launched 06:40:24.060782 run osmo-stp_10.42.42.5(pid=18849): Launched 06:40:24.180283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:24.722801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18851): Launched 06:40:24.843835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:25.110734 run patchelf(pid=18852): Launched 06:40:25.286518 run osmo-stp_10.42.42.5(pid=18849): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18849)] 06:40:25.419451 run osmo-stp_10.42.42.5(pid=18849): stdout: | (launched: 2022-12-14_06:40:24.002805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:25.554158 run osmo-stp_10.42.42.5(pid=18849): stderr: | 20221214064024176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064024177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064024178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064024178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064024179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064024179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064024179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:25.689343 run osmo-stp_10.42.42.5(pid=18849): stdout: | (launched: 2022-12-14_06:40:24.002805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:25.817720 run osmo-stp_10.42.42.5(pid=18849): stderr: | 20221214064024176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064024177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064024178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064024178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064024179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064024179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064024179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:25.970015 run patchelf(pid=18852): Terminating (SIGINT) 06:40:26.145952 run patchelf(pid=18852): Terminated: ok {rc=0} 06:40:26.273132 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18849): Process ended prematurely: osmo-stp_10.42.42.5(pid=18849) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18849)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 06:40:26.282744 tst iperf3.py:8: Test FAILED (7.7 sec) 06:40:26.310037 run osmo-hlr_10.42.42.2(pid=18846): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18846)] 06:40:26.358489 run osmo-hlr_10.42.42.2(pid=18846): stdout: | (launched: 2022-12-14_06:40:23.015376) 06:40:26.408424 run osmo-hlr_10.42.42.2(pid=18846): stderr: | 20221214064023196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064023196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064023196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064023196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064023196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064023196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064023208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064023217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064023217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064023217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:26.458570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18841): Terminating (SIGTERM) 06:40:26.498705 run iperf3-srv_10.42.42.10(pid=18842): Terminating (SIGTERM) 06:40:26.538737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18845): Terminating (SIGTERM) 06:40:26.578715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18848): Terminating (SIGTERM) 06:40:26.618603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18851): Terminating (SIGTERM) 06:40:26.659075 --- ParallelTerminationStrategy: PID 18841 died... 06:40:26.678616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18841): Terminated: ok {rc=0} 06:40:26.723034 --- ParallelTerminationStrategy: PID 18842 died... 06:40:26.742005 run iperf3-srv_10.42.42.10(pid=18842): Terminated {rc=256} 06:40:26.786205 --- ParallelTerminationStrategy: PID 18845 died... 06:40:26.805340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18845): Terminated: ok {rc=0} 06:40:26.849752 --- ParallelTerminationStrategy: PID 18848 died... 06:40:26.868757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18848): Terminated: ok {rc=0} 06:40:26.912839 --- ParallelTerminationStrategy: PID 18851 died... 06:40:26.932200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18851): Terminated: ok {rc=0} 06:40:27.018788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:40:28.168602 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.180408 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:40:28.232331 tst iperf3m4.py: using LAC 39101 06:40:28.353352 tst iperf3m4.py: using RAC 86 06:40:28.476035 tst iperf3m4.py: using CellId 39101 06:40:28.599622 tst iperf3m4.py: using BVCI 39102 06:40:28.713793 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.724704 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.735589 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.746411 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.757960 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.769490 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.781214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.792738 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:28.804373 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:28.923537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:29.047803 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:29.167514 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:29.288108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:40:29.501308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:29.818868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18853): Launched 06:40:30.093330 run iperf3-srv_10.42.42.10(pid=18854): Launched 06:40:30.211331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:40:30.423104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:30.739602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18855): Launched 06:40:31.056933 run iperf3-srv_10.42.42.10(pid=18856): Launched 06:40:31.245332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:40:31.496629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:31.823259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18857): Launched 06:40:32.117298 run iperf3-srv_10.42.42.10(pid=18858): Launched 06:40:32.253111 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:40:32.466581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:32.785456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18859): Launched 06:40:33.059157 run iperf3-srv_10.42.42.10(pid=18860): Launched 06:40:33.176881 tst iperf3m4.py:8: start network... 06:40:33.388221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:33.875120 run create_hlr_db(pid=18861): Launched 06:40:33.996407 bus /gobi_6: Setting Powered False 06:40:35.058858 run create_hlr_db(pid=18861): Terminated: ok {rc=0} 06:40:35.515327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Launched 06:40:35.850767 run osmo-hlr_10.42.42.2(pid=18864): Launched 06:40:35.979851 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:36.560217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Launched 06:40:36.897415 run osmo-stp_10.42.42.5(pid=18867): Launched 06:40:37.024593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:37.602039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18869): Launched 06:40:37.730986 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:38.015638 run patchelf(pid=18870): Launched 06:40:38.201160 run osmo-stp_10.42.42.5(pid=18867): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] 06:40:38.342559 run osmo-stp_10.42.42.5(pid=18867): stdout: | (launched: 2022-12-14_06:40:36.835279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:38.486315 run osmo-stp_10.42.42.5(pid=18867): stderr: | 20221214064037031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064037031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064037031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064037031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064037032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064037032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064037032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:38.629286 run osmo-stp_10.42.42.5(pid=18867): stdout: | (launched: 2022-12-14_06:40:36.835279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:38.766014 run osmo-stp_10.42.42.5(pid=18867): stderr: | 20221214064037031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064037031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064037031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064037031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064037032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064037032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064037032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:38.927858 run patchelf(pid=18870): Terminating (SIGINT) 06:40:39.115616 run patchelf(pid=18870): Terminated: ok {rc=0} 06:40:39.250024 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18867): Process ended prematurely: osmo-stp_10.42.42.5(pid=18867) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 06:40:39.260295 tst iperf3m4.py:8: Test FAILED (11.1 sec) 06:40:39.289447 run osmo-hlr_10.42.42.2(pid=18864): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18864)] 06:40:39.339522 run osmo-hlr_10.42.42.2(pid=18864): stdout: | (launched: 2022-12-14_06:40:35.789402) 06:40:39.391477 run osmo-hlr_10.42.42.2(pid=18864): stderr: | 20221214064035990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064035990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064035990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064035990 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064035990 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064035990 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064036002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064036013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064036013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064036013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:39.443707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18853): Terminating (SIGTERM) 06:40:39.485590 run iperf3-srv_10.42.42.10(pid=18854): Terminating (SIGTERM) 06:40:39.527955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18855): Terminating (SIGTERM) 06:40:39.569872 run iperf3-srv_10.42.42.10(pid=18856): Terminating (SIGTERM) 06:40:39.612076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18857): Terminating (SIGTERM) 06:40:39.654409 run iperf3-srv_10.42.42.10(pid=18858): Terminating (SIGTERM) 06:40:39.696557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18859): Terminating (SIGTERM) 06:40:39.738422 run iperf3-srv_10.42.42.10(pid=18860): Terminating (SIGTERM) 06:40:39.780572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Terminating (SIGTERM) 06:40:39.822523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Terminating (SIGTERM) 06:40:39.864366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18869): Terminating (SIGTERM) 06:40:39.906692 --- ParallelTerminationStrategy: PID 18853 died... 06:40:39.927104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18853): Terminated: ok {rc=0} 06:40:39.973708 --- ParallelTerminationStrategy: PID 18854 died... 06:40:39.993544 run iperf3-srv_10.42.42.10(pid=18854): Terminated {rc=256} 06:40:40.039677 --- ParallelTerminationStrategy: PID 18855 died... 06:40:40.059325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18855): Terminated: ok {rc=0} 06:40:40.105561 --- ParallelTerminationStrategy: PID 18856 died... 06:40:40.125224 run iperf3-srv_10.42.42.10(pid=18856): Terminated {rc=256} 06:40:40.171530 --- ParallelTerminationStrategy: PID 18857 died... 06:40:40.191254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18857): Terminated: ok {rc=0} 06:40:40.237476 --- ParallelTerminationStrategy: PID 18858 died... 06:40:40.256889 run iperf3-srv_10.42.42.10(pid=18858): Terminated {rc=256} 06:40:40.303495 --- ParallelTerminationStrategy: PID 18859 died... 06:40:40.323227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18859): Terminated: ok {rc=0} 06:40:40.369555 --- ParallelTerminationStrategy: PID 18860 died... 06:40:40.389354 run iperf3-srv_10.42.42.10(pid=18860): Terminated {rc=256} 06:40:40.435783 --- ParallelTerminationStrategy: PID 18863 died... 06:40:40.455618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Terminated: ok {rc=0} 06:40:40.502187 --- ParallelTerminationStrategy: PID 18866 died... 06:40:40.521938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Terminated: ok {rc=0} 06:40:40.568217 --- ParallelTerminationStrategy: PID 18869 died... 06:40:40.588060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18869): Terminated: ok {rc=0} 06:40:40.675949 bus /gobi_4: Setting Powered False 06:40:41.774865 bus /gobi_4: Setting Powered False 06:40:42.893443 bus /gobi_1: Setting Powered False 06:40:43.993245 bus /gobi_1: Setting Powered False 06:40:45.107901 bus /gobi_0: Setting Powered False 06:40:46.225286 bus /gobi_0: Setting Powered False 06:40:47.359079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 06:40:48.463626 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:48.475494 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:40:48.528921 tst ping.py: using LAC 39102 06:40:48.660167 tst ping.py: using RAC 87 06:40:48.783653 tst ping.py: using CellId 39102 06:40:48.905809 tst ping.py: using BVCI 39103 06:40:49.021838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.032838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.043902 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.054696 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.065863 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.076788 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.088066 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:49.099228 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:49.215391 tst ping.py:19: start network... 06:40:49.422411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:49.899196 run create_hlr_db(pid=18871): Launched 06:40:50.016498 bus /gobi_6: Setting Powered False 06:40:51.077749 run create_hlr_db(pid=18871): Terminated: ok {rc=0} 06:40:51.528833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18873): Launched 06:40:51.859602 run osmo-hlr_10.42.42.2(pid=18874): Launched 06:40:51.988174 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:52.560397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18877): Launched 06:40:52.889542 run osmo-stp_10.42.42.5(pid=18878): Launched 06:40:53.016309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:53.585233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18880): Launched 06:40:53.710759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:53.991125 run patchelf(pid=18881): Launched 06:40:54.175454 run osmo-stp_10.42.42.5(pid=18878): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18878)] 06:40:54.314646 run osmo-stp_10.42.42.5(pid=18878): stdout: | (launched: 2022-12-14_06:40:52.828720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:54.455312 run osmo-stp_10.42.42.5(pid=18878): stderr: | 20221214064053028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064053028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064053028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064053028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064053029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064053029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064053029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:54.596647 run osmo-stp_10.42.42.5(pid=18878): stdout: | (launched: 2022-12-14_06:40:52.828720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:54.730946 run osmo-stp_10.42.42.5(pid=18878): stderr: | 20221214064053028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064053028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064053028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064053028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064053029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064053029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064053029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:54.890566 run patchelf(pid=18881): Terminating (SIGINT) 06:40:55.074321 run patchelf(pid=18881): Terminated: ok {rc=0} 06:40:55.206340 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18878): Process ended prematurely: osmo-stp_10.42.42.5(pid=18878) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18878)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 06:40:55.216049 tst ping.py:22: Test FAILED (6.7 sec) 06:40:55.244377 run osmo-hlr_10.42.42.2(pid=18874): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18874)] 06:40:55.294119 run osmo-hlr_10.42.42.2(pid=18874): stdout: | (launched: 2022-12-14_06:40:51.799175) 06:40:55.345540 run osmo-hlr_10.42.42.2(pid=18874): stderr: | 20221214064052011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064052011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064052011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064052011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064052011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064052011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064052022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064052033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064052033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064052033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:55.397268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18873): Terminating (SIGTERM) 06:40:55.438828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18877): Terminating (SIGTERM) 06:40:55.481219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18880): Terminating (SIGTERM) 06:40:55.523750 --- ParallelTerminationStrategy: PID 18873 died... 06:40:55.543749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18873): Terminated: ok {rc=0} 06:40:55.590537 --- ParallelTerminationStrategy: PID 18877 died... 06:40:55.610361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18877): Terminated: ok {rc=0} 06:40:55.657051 --- ParallelTerminationStrategy: PID 18880 died... 06:40:55.677008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18880): Terminated: ok {rc=0} 06:40:55.765871 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:40:56.853757 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:56.866102 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:40:56.920634 tst ping_idle_ping.py: using LAC 39103 06:40:57.051753 tst ping_idle_ping.py: using RAC 88 06:40:57.180392 tst ping_idle_ping.py: using CellId 39103 06:40:57.310262 tst ping_idle_ping.py: using BVCI 39104 06:40:57.430436 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.442061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.453497 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.464673 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.476006 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.487424 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.499072 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:40:57.510532 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:40:57.627782 tst ping_idle_ping.py:24: start network... 06:40:57.837335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:58.321007 run create_hlr_db(pid=18882): Launched 06:40:58.439232 bus /gobi_6: Setting Powered False 06:40:59.500805 run create_hlr_db(pid=18882): Terminated: ok {rc=0} 06:40:59.953194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Launched 06:41:00.283563 run osmo-hlr_10.42.42.2(pid=18885): Launched 06:41:00.410627 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:00.993318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18887): Launched 06:41:01.344037 run osmo-stp_10.42.42.5(pid=18888): Launched 06:41:01.644857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:02.345928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18890): Launched 06:41:02.465447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:02.728062 run patchelf(pid=18891): Launched 06:41:02.900496 run osmo-stp_10.42.42.5(pid=18888): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18888)] 06:41:03.031619 run osmo-stp_10.42.42.5(pid=18888): stdout: | (launched: 2022-12-14_06:41:01.281072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:03.165202 run osmo-stp_10.42.42.5(pid=18888): stderr: | 20221214064101571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064101572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064101574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064101575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064101577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064101577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064101578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:03.298512 run osmo-stp_10.42.42.5(pid=18888): stdout: | (launched: 2022-12-14_06:41:01.281072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:03.425387 run osmo-stp_10.42.42.5(pid=18888): stderr: | 20221214064101571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064101572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064101574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064101575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064101577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064101577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064101578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:03.575197 run patchelf(pid=18891): Terminating (SIGINT) 06:41:03.748636 run patchelf(pid=18891): Terminated: ok {rc=0} 06:41:03.873814 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18888): Process ended prematurely: osmo-stp_10.42.42.5(pid=18888) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18888)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 06:41:03.882860 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 06:41:03.909668 run osmo-hlr_10.42.42.2(pid=18885): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18885)] 06:41:03.958500 run osmo-hlr_10.42.42.2(pid=18885): stdout: | (launched: 2022-12-14_06:41:00.222728) 06:41:04.008518 run osmo-hlr_10.42.42.2(pid=18885): stderr: | 20221214064100423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064100423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064100423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064100423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064100423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064100423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064100436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064100446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064100446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064100447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:04.058421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Terminating (SIGTERM) 06:41:04.098648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18887): Terminating (SIGTERM) 06:41:04.138888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18890): Terminating (SIGTERM) 06:41:04.179492 --- ParallelTerminationStrategy: PID 18884 died... 06:41:04.199387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Terminated: ok {rc=0} 06:41:04.244109 --- ParallelTerminationStrategy: PID 18887 died... 06:41:04.263724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18887): Terminated: ok {rc=0} 06:41:04.308415 --- ParallelTerminationStrategy: PID 18890 died... 06:41:04.327964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18890): Terminated: ok {rc=0} 06:41:04.415874 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:41:05.724649 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:41:05.732348 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:41:05.766158 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:41:05.805952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:41:05.894850 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:41:05.928020 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:41:05.968074 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:41:06.565883 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:41:06.621195 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:06.632149 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:41:06.700147 tst cs_paging_gprs_active.py: using LAC 39104 06:41:06.823072 tst cs_paging_gprs_active.py: using RAC 89 06:41:06.946463 tst cs_paging_gprs_active.py: using CellId 39104 06:41:07.070197 tst cs_paging_gprs_active.py: using BVCI 39105 06:41:07.186595 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.197894 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.208724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.219563 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.230699 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.241934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.253115 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.264060 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:07.275252 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:07.396311 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:07.516344 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:41:07.730102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:08.047631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18895): Launched 06:41:08.321881 run iperf3-srv_10.42.42.10(pid=18896): Launched 06:41:08.439697 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:41:08.651074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:08.967863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18897): Launched 06:41:09.241391 run iperf3-srv_10.42.42.10(pid=18898): Launched 06:41:09.359269 tst cs_paging_gprs_active.py:38: start network... 06:41:09.570767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:10.057374 run create_hlr_db(pid=18899): Launched 06:41:10.177142 bus /gobi_6: Setting Powered False 06:41:11.241621 run create_hlr_db(pid=18899): Terminated: ok {rc=0} 06:41:11.690917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Launched 06:41:12.006801 run osmo-hlr_10.42.42.2(pid=18902): Launched 06:41:12.127543 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:12.679722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Launched 06:41:12.995466 run osmo-stp_10.42.42.5(pid=18905): Launched 06:41:13.116530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:13.660032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18907): Launched 06:41:13.782117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:14.048532 run patchelf(pid=18908): Launched 06:41:14.223441 run osmo-stp_10.42.42.5(pid=18905): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] 06:41:14.356851 run osmo-stp_10.42.42.5(pid=18905): stdout: | (launched: 2022-12-14_06:41:12.937318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:14.492062 run osmo-stp_10.42.42.5(pid=18905): stderr: | 20221214064113111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064113111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064113111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064113111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064113112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064113112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064113112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:14.627216 run osmo-stp_10.42.42.5(pid=18905): stdout: | (launched: 2022-12-14_06:41:12.937318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:14.756483 run osmo-stp_10.42.42.5(pid=18905): stderr: | 20221214064113111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064113111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064113111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064113111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064113112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064113112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064113112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:14.909809 run patchelf(pid=18908): Terminating (SIGINT) 06:41:15.086916 run patchelf(pid=18908): Terminated: ok {rc=0} 06:41:15.214552 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18905): Process ended prematurely: osmo-stp_10.42.42.5(pid=18905) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:41:15.224219 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:41:15.251555 run osmo-hlr_10.42.42.2(pid=18902): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18902)] 06:41:15.299728 run osmo-hlr_10.42.42.2(pid=18902): stdout: | (launched: 2022-12-14_06:41:11.948097) 06:41:15.349949 run osmo-hlr_10.42.42.2(pid=18902): stderr: | 20221214064112128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064112128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064112128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064112128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064112128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064112128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064112140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064112148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064112148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064112148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:15.400155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18895): Terminating (SIGTERM) 06:41:15.440506 run iperf3-srv_10.42.42.10(pid=18896): Terminating (SIGTERM) 06:41:15.480632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18897): Terminating (SIGTERM) 06:41:15.520765 run iperf3-srv_10.42.42.10(pid=18898): Terminating (SIGTERM) 06:41:15.560925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Terminating (SIGTERM) 06:41:15.601220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Terminating (SIGTERM) 06:41:15.641652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18907): Terminating (SIGTERM) 06:41:15.681986 --- ParallelTerminationStrategy: PID 18895 died... 06:41:15.701459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18895): Terminated: ok {rc=0} 06:41:15.746183 --- ParallelTerminationStrategy: PID 18896 died... 06:41:15.765261 run iperf3-srv_10.42.42.10(pid=18896): Terminated {rc=256} 06:41:15.809343 --- ParallelTerminationStrategy: PID 18897 died... 06:41:15.838659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18897): Terminated: ok {rc=0} 06:41:15.898148 --- ParallelTerminationStrategy: PID 18898 died... 06:41:15.921941 run iperf3-srv_10.42.42.10(pid=18898): Terminated {rc=256} 06:41:15.973266 --- ParallelTerminationStrategy: PID 18901 died... 06:41:15.993333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Terminated: ok {rc=0} 06:41:16.038708 --- ParallelTerminationStrategy: PID 18904 died... 06:41:16.058608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Terminated: ok {rc=0} 06:41:16.104925 --- ParallelTerminationStrategy: PID 18907 died... 06:41:16.125494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18907): Terminated: ok {rc=0} 06:41:16.212437 bus /gobi_0: Setting Powered False 06:41:17.307692 bus /gobi_0: Setting Powered False 06:41:18.424024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:41:19.572565 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:19.584611 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:41:19.654603 tst iperf3.py: using LAC 39105 06:41:19.778534 tst iperf3.py: using RAC 90 06:41:19.902118 tst iperf3.py: using CellId 39105 06:41:20.026597 tst iperf3.py: using BVCI 39106 06:41:20.142493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.153633 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.164434 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.175263 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.186459 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.197592 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.208759 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.219792 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:20.230980 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:20.351691 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:41:20.581205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:20.920438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18909): Launched 06:41:21.216104 run iperf3-srv_10.42.42.10(pid=18910): Launched 06:41:21.342053 tst iperf3.py:8: start network... 06:41:21.569266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:22.090709 run create_hlr_db(pid=18911): Launched 06:41:22.226701 bus /gobi_6: Setting Powered False 06:41:23.292166 run create_hlr_db(pid=18911): Terminated: ok {rc=0} 06:41:23.739112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18913): Launched 06:41:24.055657 run osmo-hlr_10.42.42.2(pid=18914): Launched 06:41:24.177910 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:24.721663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18916): Launched 06:41:25.036775 run osmo-stp_10.42.42.5(pid=18917): Launched 06:41:25.157143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:25.699890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18919): Launched 06:41:25.820718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:26.087657 run patchelf(pid=18920): Launched 06:41:26.263528 run osmo-stp_10.42.42.5(pid=18917): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18917)] 06:41:26.396230 run osmo-stp_10.42.42.5(pid=18917): stdout: | (launched: 2022-12-14_06:41:24.978342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:26.531066 run osmo-stp_10.42.42.5(pid=18917): stderr: | 20221214064125152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064125152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064125153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064125153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064125154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064125154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064125154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:26.665663 run osmo-stp_10.42.42.5(pid=18917): stdout: | (launched: 2022-12-14_06:41:24.978342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:26.794237 run osmo-stp_10.42.42.5(pid=18917): stderr: | 20221214064125152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064125152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064125153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064125153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064125154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064125154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064125154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:26.946610 run patchelf(pid=18920): Terminating (SIGINT) 06:41:27.123413 run patchelf(pid=18920): Terminated: ok {rc=0} 06:41:27.250755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18917): Process ended prematurely: osmo-stp_10.42.42.5(pid=18917) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18917)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 06:41:27.260305 tst iperf3.py:8: Test FAILED (7.7 sec) 06:41:27.287438 run osmo-hlr_10.42.42.2(pid=18914): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18914)] 06:41:27.335043 run osmo-hlr_10.42.42.2(pid=18914): stdout: | (launched: 2022-12-14_06:41:23.997380) 06:41:27.384258 run osmo-hlr_10.42.42.2(pid=18914): stderr: | 20221214064124173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064124173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064124173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064124173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064124173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064124173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064124185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064124193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064124194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064124194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:27.433983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18909): Terminating (SIGTERM) 06:41:27.473775 run iperf3-srv_10.42.42.10(pid=18910): Terminating (SIGTERM) 06:41:27.513819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18913): Terminating (SIGTERM) 06:41:27.553418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18916): Terminating (SIGTERM) 06:41:27.592902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18919): Terminating (SIGTERM) 06:41:27.632727 --- ParallelTerminationStrategy: PID 18909 died... 06:41:27.652146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18909): Terminated: ok {rc=0} 06:41:27.696144 --- ParallelTerminationStrategy: PID 18910 died... 06:41:27.714987 run iperf3-srv_10.42.42.10(pid=18910): Terminated {rc=256} 06:41:27.758831 --- ParallelTerminationStrategy: PID 18913 died... 06:41:27.777833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18913): Terminated: ok {rc=0} 06:41:27.822050 --- ParallelTerminationStrategy: PID 18916 died... 06:41:27.841061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18916): Terminated: ok {rc=0} 06:41:27.885863 --- ParallelTerminationStrategy: PID 18919 died... 06:41:27.904661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18919): Terminated: ok {rc=0} 06:41:27.988407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:41:29.139071 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.151521 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:41:29.221560 tst iperf3m4.py: using LAC 39106 06:41:29.345222 tst iperf3m4.py: using RAC 91 06:41:29.469583 tst iperf3m4.py: using CellId 39106 06:41:29.594631 tst iperf3m4.py: using BVCI 39107 06:41:29.709969 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.721152 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.732105 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.742919 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.754010 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.765168 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.776380 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.787368 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:29.798656 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:29.920938 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:30.046130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:30.168619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:30.287370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:41:30.501302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:30.819677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18921): Launched 06:41:31.125351 run iperf3-srv_10.42.42.10(pid=18922): Launched 06:41:31.292598 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:41:31.584760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:31.936510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18923): Launched 06:41:32.247291 run iperf3-srv_10.42.42.10(pid=18924): Launched 06:41:32.386016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:41:32.614402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:32.953932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18925): Launched 06:41:33.248454 run iperf3-srv_10.42.42.10(pid=18926): Launched 06:41:33.375277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:41:33.602825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:41:33.941678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18927): Launched 06:41:34.235527 run iperf3-srv_10.42.42.10(pid=18928): Launched 06:41:34.361226 tst iperf3m4.py:8: start network... 06:41:34.589172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:35.112378 run create_hlr_db(pid=18929): Launched 06:41:35.249266 bus /gobi_6: Setting Powered False 06:41:36.315583 run create_hlr_db(pid=18929): Terminated: ok {rc=0} 06:41:36.762964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18931): Launched 06:41:37.078267 run osmo-hlr_10.42.42.2(pid=18932): Launched 06:41:37.198160 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:37.742483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18934): Launched 06:41:38.060333 run osmo-stp_10.42.42.5(pid=18935): Launched 06:41:38.184304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:38.727382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18937): Launched 06:41:38.849251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:39.116635 run patchelf(pid=18938): Launched 06:41:39.290987 run osmo-stp_10.42.42.5(pid=18935): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18935)] 06:41:39.423939 run osmo-stp_10.42.42.5(pid=18935): stdout: | (launched: 2022-12-14_06:41:38.001999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:39.558285 run osmo-stp_10.42.42.5(pid=18935): stderr: | 20221214064138173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064138173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064138173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064138174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064138174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064138174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064138174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:39.692484 run osmo-stp_10.42.42.5(pid=18935): stdout: | (launched: 2022-12-14_06:41:38.001999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:39.820553 run osmo-stp_10.42.42.5(pid=18935): stderr: | 20221214064138173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064138173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064138173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064138174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064138174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064138174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064138174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:39.972337 run patchelf(pid=18938): Terminating (SIGINT) 06:41:40.148606 run patchelf(pid=18938): Terminated: ok {rc=0} 06:41:40.275736 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18935): Process ended prematurely: osmo-stp_10.42.42.5(pid=18935) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18935)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:41:40.285444 tst iperf3m4.py:8: Test FAILED (11.2 sec) 06:41:40.312707 run osmo-hlr_10.42.42.2(pid=18932): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18932)] 06:41:40.361131 run osmo-hlr_10.42.42.2(pid=18932): stdout: | (launched: 2022-12-14_06:41:37.020224) 06:41:40.410800 run osmo-hlr_10.42.42.2(pid=18932): stderr: | 20221214064137199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064137199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064137199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064137199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064137199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064137199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064137211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064137219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064137219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064137220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:40.460830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18921): Terminating (SIGTERM) 06:41:40.501036 run iperf3-srv_10.42.42.10(pid=18922): Terminating (SIGTERM) 06:41:40.541202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18923): Terminating (SIGTERM) 06:41:40.581321 run iperf3-srv_10.42.42.10(pid=18924): Terminating (SIGTERM) 06:41:40.621157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18925): Terminating (SIGTERM) 06:41:40.661195 run iperf3-srv_10.42.42.10(pid=18926): Terminating (SIGTERM) 06:41:40.701198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18927): Terminating (SIGTERM) 06:41:40.741128 run iperf3-srv_10.42.42.10(pid=18928): Terminating (SIGTERM) 06:41:40.781096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18931): Terminating (SIGTERM) 06:41:40.821194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18934): Terminating (SIGTERM) 06:41:40.861102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18937): Terminating (SIGTERM) 06:41:40.901465 --- ParallelTerminationStrategy: PID 18921 died... 06:41:40.920913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18921): Terminated: ok {rc=0} 06:41:40.965681 --- ParallelTerminationStrategy: PID 18922 died... 06:41:40.984557 run iperf3-srv_10.42.42.10(pid=18922): Terminated {rc=256} 06:41:41.029228 --- ParallelTerminationStrategy: PID 18923 died... 06:41:41.048188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18923): Terminated: ok {rc=0} 06:41:41.092647 --- ParallelTerminationStrategy: PID 18924 died... 06:41:41.111794 run iperf3-srv_10.42.42.10(pid=18924): Terminated {rc=256} 06:41:41.156044 --- ParallelTerminationStrategy: PID 18925 died... 06:41:41.175155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18925): Terminated: ok {rc=0} 06:41:41.219553 --- ParallelTerminationStrategy: PID 18926 died... 06:41:41.238745 run iperf3-srv_10.42.42.10(pid=18926): Terminated {rc=256} 06:41:41.282951 --- ParallelTerminationStrategy: PID 18927 died... 06:41:41.302132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18927): Terminated: ok {rc=0} 06:41:41.346492 --- ParallelTerminationStrategy: PID 18928 died... 06:41:41.365518 run iperf3-srv_10.42.42.10(pid=18928): Terminated {rc=256} 06:41:41.409760 --- ParallelTerminationStrategy: PID 18931 died... 06:41:41.428790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18931): Terminated: ok {rc=0} 06:41:41.473054 --- ParallelTerminationStrategy: PID 18934 died... 06:41:41.492455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18934): Terminated: ok {rc=0} 06:41:41.536805 --- ParallelTerminationStrategy: PID 18937 died... 06:41:41.556421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18937): Terminated: ok {rc=0} 06:41:41.643260 bus /gobi_4: Setting Powered False 06:41:42.742882 bus /gobi_4: Setting Powered False 06:41:43.857588 bus /gobi_1: Setting Powered False 06:41:44.955718 bus /gobi_1: Setting Powered False 06:41:46.078139 bus /gobi_0: Setting Powered False 06:41:47.190330 bus /gobi_0: Setting Powered False 06:41:48.307789 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:41:49.410734 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:49.423170 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:41:49.492011 tst ping.py: using LAC 39107 06:41:49.620291 tst ping.py: using RAC 92 06:41:49.750182 tst ping.py: using CellId 39107 06:41:49.880537 tst ping.py: using BVCI 39108 06:41:50.000866 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.012508 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.023872 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.035102 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.046280 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.057657 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.069024 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:50.080185 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:50.196604 tst ping.py:19: start network... 06:41:50.405500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:50.884050 run create_hlr_db(pid=18939): Launched 06:41:51.010027 bus /gobi_6: Setting Powered False 06:41:52.071042 run create_hlr_db(pid=18939): Terminated: ok {rc=0} 06:41:52.522520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18941): Launched 06:41:52.852326 run osmo-hlr_10.42.42.2(pid=18942): Launched 06:41:52.980313 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:53.556689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18944): Launched 06:41:53.888344 run osmo-stp_10.42.42.5(pid=18945): Launched 06:41:54.013880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:54.585044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18947): Launched 06:41:54.711431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:54.992845 run patchelf(pid=18948): Launched 06:41:55.178548 run osmo-stp_10.42.42.5(pid=18945): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18945)] 06:41:55.318567 run osmo-stp_10.42.42.5(pid=18945): stdout: | (launched: 2022-12-14_06:41:53.827243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:55.460231 run osmo-stp_10.42.42.5(pid=18945): stderr: | 20221214064154022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064154022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064154023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064154023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064154024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064154024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064154024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:55.601651 run osmo-stp_10.42.42.5(pid=18945): stdout: | (launched: 2022-12-14_06:41:53.827243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:55.736323 run osmo-stp_10.42.42.5(pid=18945): stderr: | 20221214064154022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064154022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064154023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064154023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064154024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064154024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064154024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:55.896360 run patchelf(pid=18948): Terminating (SIGINT) 06:41:56.081097 run patchelf(pid=18948): Terminated: ok {rc=0} 06:41:56.213641 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18945): Process ended prematurely: osmo-stp_10.42.42.5(pid=18945) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18945)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 06:41:56.223476 tst ping.py:22: Test FAILED (6.8 sec) 06:41:56.251894 run osmo-hlr_10.42.42.2(pid=18942): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18942)] 06:41:56.302325 run osmo-hlr_10.42.42.2(pid=18942): stdout: | (launched: 2022-12-14_06:41:52.791754) 06:41:56.354184 run osmo-hlr_10.42.42.2(pid=18942): stderr: | 20221214064152993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064152993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064152994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064152994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064152994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064152994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064153006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064153015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064153015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064153015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:56.406507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18941): Terminating (SIGTERM) 06:41:56.448646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18944): Terminating (SIGTERM) 06:41:56.490894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18947): Terminating (SIGTERM) 06:41:56.533804 --- ParallelTerminationStrategy: PID 18941 died... 06:41:56.554012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18941): Terminated: ok {rc=0} 06:41:56.601115 --- ParallelTerminationStrategy: PID 18944 died... 06:41:56.621173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18944): Terminated: ok {rc=0} 06:41:56.667700 --- ParallelTerminationStrategy: PID 18947 died... 06:41:56.687636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18947): Terminated: ok {rc=0} 06:41:56.775092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:41:57.862314 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:57.874260 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:41:57.942047 tst ping_idle_ping.py: using LAC 39108 06:41:58.065588 tst ping_idle_ping.py: using RAC 93 06:41:58.188819 tst ping_idle_ping.py: using CellId 39108 06:41:58.310224 tst ping_idle_ping.py: using BVCI 39109 06:41:58.425158 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.436101 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.447064 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.457949 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.469067 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.480219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.491469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:41:58.502655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:41:58.620414 tst ping_idle_ping.py:24: start network... 06:41:58.830636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:59.317446 run create_hlr_db(pid=18949): Launched 06:41:59.443407 bus /gobi_6: Setting Powered False 06:42:00.504890 run create_hlr_db(pid=18949): Terminated: ok {rc=0} 06:42:01.068539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18959): Launched 06:42:01.418718 run osmo-hlr_10.42.42.2(pid=18960): Launched 06:42:01.649493 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:02.312341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18962): Launched 06:42:02.645928 run osmo-stp_10.42.42.5(pid=18963): Launched 06:42:02.772257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:42:03.344053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18965): Launched 06:42:03.472811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:42:03.753885 run patchelf(pid=18966): Launched 06:42:03.937847 run osmo-stp_10.42.42.5(pid=18963): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18963)] 06:42:04.077838 run osmo-stp_10.42.42.5(pid=18963): stdout: | (launched: 2022-12-14_06:42:02.584546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:04.219431 run osmo-stp_10.42.42.5(pid=18963): stderr: | 20221214064202782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064202782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064202782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064202782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064202783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064202783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064202783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:04.360720 run osmo-stp_10.42.42.5(pid=18963): stdout: | (launched: 2022-12-14_06:42:02.584546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:04.495933 run osmo-stp_10.42.42.5(pid=18963): stderr: | 20221214064202782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064202782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064202782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064202782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064202783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064202783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064202783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:04.656104 run patchelf(pid=18966): Terminating (SIGINT) 06:42:04.840239 run patchelf(pid=18966): Terminated: ok {rc=0} 06:42:04.972809 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18963): Process ended prematurely: osmo-stp_10.42.42.5(pid=18963) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18963)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:42:04.982925 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 06:42:05.010978 run osmo-hlr_10.42.42.2(pid=18960): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18960)] 06:42:05.060779 run osmo-hlr_10.42.42.2(pid=18960): stdout: | (launched: 2022-12-14_06:42:01.355281) 06:42:05.112624 run osmo-hlr_10.42.42.2(pid=18960): stderr: | 20221214064201673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064201673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064201673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064201673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064201674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064201674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064201694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064201707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064201707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064201707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:05.165341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18959): Terminating (SIGTERM) 06:42:05.206982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18962): Terminating (SIGTERM) 06:42:05.249396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18965): Terminating (SIGTERM) 06:42:05.291313 --- ParallelTerminationStrategy: PID 18959 died... 06:42:05.311384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18959): Terminated: ok {rc=0} 06:42:05.357524 --- ParallelTerminationStrategy: PID 18962 died... 06:42:05.377211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18962): Terminated: ok {rc=0} 06:42:05.423195 --- ParallelTerminationStrategy: PID 18965 died... 06:42:05.442723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18965): Terminated: ok {rc=0} 06:42:05.529938 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:42:06.836838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:42:06.846263 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:42:06.879260 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 06:42:06.918352 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 06:42:07.007834 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:42:07.040466 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 06:42:07.079303 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 06:42:07.682021 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 06:42:07.734222 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:07.745595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:42:07.794197 tst cs_paging_gprs_active.py: using LAC 39109 06:42:07.917655 tst cs_paging_gprs_active.py: using RAC 94 06:42:08.051227 tst cs_paging_gprs_active.py: using CellId 39109 06:42:08.179929 tst cs_paging_gprs_active.py: using BVCI 39110 06:42:08.301564 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.313551 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.325400 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.337227 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.348941 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.360643 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.372589 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.384269 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:08.396236 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:08.514518 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:08.634425 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:42:08.859659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:09.194120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18970): Launched 06:42:09.484219 run iperf3-srv_10.42.42.10(pid=18971): Launched 06:42:09.608358 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:42:09.832437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:10.166147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18972): Launched 06:42:10.454563 run iperf3-srv_10.42.42.10(pid=18973): Launched 06:42:10.580273 tst cs_paging_gprs_active.py:38: start network... 06:42:10.804559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:11.320849 run create_hlr_db(pid=18974): Launched 06:42:11.455822 bus /gobi_6: Setting Powered False 06:42:12.520397 run create_hlr_db(pid=18974): Terminated: ok {rc=0} 06:42:12.965480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18976): Launched 06:42:13.278375 run osmo-hlr_10.42.42.2(pid=18977): Launched 06:42:13.397704 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:13.934946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18979): Launched 06:42:14.247525 run osmo-stp_10.42.42.5(pid=18980): Launched 06:42:14.366982 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:42:14.905284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18982): Launched 06:42:15.024924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:42:15.289280 run patchelf(pid=18983): Launched 06:42:15.462339 run osmo-stp_10.42.42.5(pid=18980): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18980)] 06:42:15.594579 run osmo-stp_10.42.42.5(pid=18980): stdout: | (launched: 2022-12-14_06:42:14.190155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:15.728923 run osmo-stp_10.42.42.5(pid=18980): stderr: | 20221214064214363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064214363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064214364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064214364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064214365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064214365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064214365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:15.869639 run osmo-stp_10.42.42.5(pid=18980): stdout: | (launched: 2022-12-14_06:42:14.190155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:16.010609 run osmo-stp_10.42.42.5(pid=18980): stderr: | 20221214064214363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064214363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064214364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064214364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064214365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064214365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064214365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:16.174664 run patchelf(pid=18983): Terminating (SIGINT) 06:42:16.365461 run patchelf(pid=18983): Terminated: ok {rc=0} 06:42:16.504192 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18980): Process ended prematurely: osmo-stp_10.42.42.5(pid=18980) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18980)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 06:42:16.518524 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:42:16.555570 run osmo-hlr_10.42.42.2(pid=18977): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18977)] 06:42:16.617510 run osmo-hlr_10.42.42.2(pid=18977): stdout: | (launched: 2022-12-14_06:42:13.220580) 06:42:16.679870 run osmo-hlr_10.42.42.2(pid=18977): stderr: | 20221214064213397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064213397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064213397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064213397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064213397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064213397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064213454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064213464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064213465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064213465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:16.743856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18970): Terminating (SIGTERM) 06:42:16.795591 run iperf3-srv_10.42.42.10(pid=18971): Terminating (SIGTERM) 06:42:16.849174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18972): Terminating (SIGTERM) 06:42:16.901712 run iperf3-srv_10.42.42.10(pid=18973): Terminating (SIGTERM) 06:42:16.957055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18976): Terminating (SIGTERM) 06:42:17.005463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18979): Terminating (SIGTERM) 06:42:17.057263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18982): Terminating (SIGTERM) 06:42:17.108639 --- ParallelTerminationStrategy: PID 18970 died... 06:42:17.133325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18970): Terminated: ok {rc=0} 06:42:17.183812 --- ParallelTerminationStrategy: PID 18971 died... 06:42:17.203821 run iperf3-srv_10.42.42.10(pid=18971): Terminated {rc=256} 06:42:17.249958 --- ParallelTerminationStrategy: PID 18972 died... 06:42:17.270059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18972): Terminated: ok {rc=0} 06:42:17.315377 --- ParallelTerminationStrategy: PID 18973 died... 06:42:17.334912 run iperf3-srv_10.42.42.10(pid=18973): Terminated {rc=256} 06:42:17.379646 --- ParallelTerminationStrategy: PID 18976 died... 06:42:17.399187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18976): Terminated: ok {rc=0} 06:42:17.443938 --- ParallelTerminationStrategy: PID 18979 died... 06:42:17.463543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18979): Terminated: ok {rc=0} 06:42:17.508195 --- ParallelTerminationStrategy: PID 18982 died... 06:42:17.527922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18982): Terminated: ok {rc=0} 06:42:17.614909 bus /gobi_0: Setting Powered False 06:42:18.712091 bus /gobi_0: Setting Powered False 06:42:19.825700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 06:42:20.973772 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:20.986118 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:42:21.035778 tst iperf3.py: using LAC 39110 06:42:21.166743 tst iperf3.py: using RAC 95 06:42:21.298893 tst iperf3.py: using CellId 39110 06:42:21.431334 tst iperf3.py: using BVCI 39111 06:42:21.546744 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.558279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.569449 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.580651 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.592550 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.604075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.615679 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.627064 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:21.638787 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:21.761410 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:42:21.986729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:22.320272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18984): Launched 06:42:22.609628 run iperf3-srv_10.42.42.10(pid=18985): Launched 06:42:22.733493 tst iperf3.py:8: start network... 06:42:22.957374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:23.472157 run create_hlr_db(pid=18986): Launched 06:42:23.606323 bus /gobi_6: Setting Powered False 06:42:24.671207 run create_hlr_db(pid=18986): Terminated: ok {rc=0} 06:42:25.114263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18988): Launched 06:42:25.427055 run osmo-hlr_10.42.42.2(pid=18989): Launched 06:42:25.546177 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:26.099581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18991): Launched 06:42:26.411391 run osmo-stp_10.42.42.5(pid=18992): Launched 06:42:26.531154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:42:27.068122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18994): Launched 06:42:27.187913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:42:27.452670 run patchelf(pid=18995): Launched 06:42:27.625392 run osmo-stp_10.42.42.5(pid=18992): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18992)] 06:42:27.757448 run osmo-stp_10.42.42.5(pid=18992): stdout: | (launched: 2022-12-14_06:42:26.354462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:27.891175 run osmo-stp_10.42.42.5(pid=18992): stderr: | 20221214064226526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064226526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064226526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064226527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064226527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064226527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064226527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:28.025401 run osmo-stp_10.42.42.5(pid=18992): stdout: | (launched: 2022-12-14_06:42:26.354462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:28.153225 run osmo-stp_10.42.42.5(pid=18992): stderr: | 20221214064226526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064226526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064226526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064226527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064226527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064226527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064226527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:28.304157 run patchelf(pid=18995): Terminating (SIGINT) 06:42:28.478831 run patchelf(pid=18995): Terminated: ok {rc=0} 06:42:28.605421 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18992): Process ended prematurely: osmo-stp_10.42.42.5(pid=18992) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18992)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 06:42:28.615137 tst iperf3.py:8: Test FAILED (7.7 sec) 06:42:28.642177 run osmo-hlr_10.42.42.2(pid=18989): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18989)] 06:42:28.690067 run osmo-hlr_10.42.42.2(pid=18989): stdout: | (launched: 2022-12-14_06:42:25.369908) 06:42:28.739294 run osmo-hlr_10.42.42.2(pid=18989): stderr: | 20221214064225547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064225547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064225547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064225547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064225547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064225548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064225560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064225568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064225569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064225569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:28.789281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18984): Terminating (SIGTERM) 06:42:28.829087 run iperf3-srv_10.42.42.10(pid=18985): Terminating (SIGTERM) 06:42:28.868896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18988): Terminating (SIGTERM) 06:42:28.908752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18991): Terminating (SIGTERM) 06:42:28.948327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18994): Terminating (SIGTERM) 06:42:28.988189 --- ParallelTerminationStrategy: PID 18984 died... 06:42:29.007427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18984): Terminated: ok {rc=0} 06:42:29.051160 --- ParallelTerminationStrategy: PID 18985 died... 06:42:29.069832 run iperf3-srv_10.42.42.10(pid=18985): Terminated {rc=256} 06:42:29.113468 --- ParallelTerminationStrategy: PID 18988 died... 06:42:29.132181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18988): Terminated: ok {rc=0} 06:42:29.175927 --- ParallelTerminationStrategy: PID 18991 died... 06:42:29.194790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18991): Terminated: ok {rc=0} 06:42:29.238568 --- ParallelTerminationStrategy: PID 18994 died... 06:42:29.257316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18994): Terminated: ok {rc=0} 06:42:29.342703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 06:42:30.491037 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:30.503217 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:42:30.556776 tst iperf3m4.py: using LAC 39111 06:42:30.678260 tst iperf3m4.py: using RAC 96 06:42:30.800250 tst iperf3m4.py: using CellId 39111 06:42:30.954619 tst iperf3m4.py: using BVCI 39112 06:42:31.072281 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.084767 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.097292 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.109832 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.123379 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.136707 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.150234 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.163277 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:31.176887 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:31.324061 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:31.467467 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:31.596100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:31.723308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:42:31.959421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:32.307821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18996): Launched 06:42:32.598293 run iperf3-srv_10.42.42.10(pid=18997): Launched 06:42:32.722657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:42:32.947211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:33.282499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18998): Launched 06:42:33.571867 run iperf3-srv_10.42.42.10(pid=18999): Launched 06:42:33.695410 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:42:33.918998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:34.253229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19000): Launched 06:42:34.542386 run iperf3-srv_10.42.42.10(pid=19001): Launched 06:42:34.667603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:42:34.891907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:42:35.226578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19002): Launched 06:42:35.517462 run iperf3-srv_10.42.42.10(pid=19003): Launched 06:42:35.641384 tst iperf3m4.py:8: start network... 06:42:35.865115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:36.381389 run create_hlr_db(pid=19004): Launched 06:42:36.515625 bus /gobi_6: Setting Powered False 06:42:37.581352 run create_hlr_db(pid=19004): Terminated: ok {rc=0} 06:42:38.025479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19006): Launched 06:42:38.338719 run osmo-hlr_10.42.42.2(pid=19007): Launched 06:42:38.457213 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:38.998941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19009): Launched 06:42:39.312020 run osmo-stp_10.42.42.5(pid=19010): Launched 06:42:39.431841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:42:39.975926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19012): Launched 06:42:40.106585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:42:40.389281 run patchelf(pid=19013): Launched 06:42:40.573701 run osmo-stp_10.42.42.5(pid=19010): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19010)] 06:42:40.713467 run osmo-stp_10.42.42.5(pid=19010): stdout: | (launched: 2022-12-14_06:42:39.254113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:40.855567 run osmo-stp_10.42.42.5(pid=19010): stderr: | 20221214064239427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064239427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064239427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064239427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064239428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064239428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064239428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:40.997189 run osmo-stp_10.42.42.5(pid=19010): stdout: | (launched: 2022-12-14_06:42:39.254113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:41.132377 run osmo-stp_10.42.42.5(pid=19010): stderr: | 20221214064239427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064239427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064239427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064239427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064239428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064239428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064239428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:41.293009 run patchelf(pid=19013): Terminating (SIGINT) 06:42:41.478617 run patchelf(pid=19013): Terminated: ok {rc=0} 06:42:41.613099 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19010): Process ended prematurely: osmo-stp_10.42.42.5(pid=19010) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19010)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 06:42:41.623413 tst iperf3m4.py:8: Test FAILED (11.2 sec) 06:42:41.652075 run osmo-hlr_10.42.42.2(pid=19007): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19007)] 06:42:41.701804 run osmo-hlr_10.42.42.2(pid=19007): stdout: | (launched: 2022-12-14_06:42:38.280621) 06:42:41.753233 run osmo-hlr_10.42.42.2(pid=19007): stderr: | 20221214064238457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064238457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064238457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064238457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064238457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064238458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064238470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064238478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064238478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064238478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:41.805493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18996): Terminating (SIGTERM) 06:42:41.847129 run iperf3-srv_10.42.42.10(pid=18997): Terminating (SIGTERM) 06:42:41.889244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18998): Terminating (SIGTERM) 06:42:41.930789 run iperf3-srv_10.42.42.10(pid=18999): Terminating (SIGTERM) 06:42:41.972767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19000): Terminating (SIGTERM) 06:42:42.015303 run iperf3-srv_10.42.42.10(pid=19001): Terminating (SIGTERM) 06:42:42.057011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19002): Terminating (SIGTERM) 06:42:42.098648 run iperf3-srv_10.42.42.10(pid=19003): Terminating (SIGTERM) 06:42:42.140509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19006): Terminating (SIGTERM) 06:42:42.182737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19009): Terminating (SIGTERM) 06:42:42.224736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19012): Terminating (SIGTERM) 06:42:42.266751 --- ParallelTerminationStrategy: PID 18996 died... 06:42:42.286631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18996): Terminated: ok {rc=0} 06:42:42.332787 --- ParallelTerminationStrategy: PID 18997 died... 06:42:42.352686 run iperf3-srv_10.42.42.10(pid=18997): Terminated {rc=256} 06:42:42.398454 --- ParallelTerminationStrategy: PID 18998 died... 06:42:42.417999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18998): Terminated: ok {rc=0} 06:42:42.463628 --- ParallelTerminationStrategy: PID 18999 died... 06:42:42.483176 run iperf3-srv_10.42.42.10(pid=18999): Terminated {rc=256} 06:42:42.528875 --- ParallelTerminationStrategy: PID 19000 died... 06:42:42.548678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19000): Terminated: ok {rc=0} 06:42:42.594804 --- ParallelTerminationStrategy: PID 19001 died... 06:42:42.614300 run iperf3-srv_10.42.42.10(pid=19001): Terminated {rc=256} 06:42:42.660104 --- ParallelTerminationStrategy: PID 19002 died... 06:42:42.679583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19002): Terminated: ok {rc=0} 06:42:42.725275 --- ParallelTerminationStrategy: PID 19003 died... 06:42:42.744481 run iperf3-srv_10.42.42.10(pid=19003): Terminated {rc=256} 06:42:42.790619 --- ParallelTerminationStrategy: PID 19006 died... 06:42:42.810237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19006): Terminated: ok {rc=0} 06:42:42.856102 --- ParallelTerminationStrategy: PID 19009 died... 06:42:42.875656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19009): Terminated: ok {rc=0} 06:42:42.921554 --- ParallelTerminationStrategy: PID 19012 died... 06:42:42.941263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19012): Terminated: ok {rc=0} 06:42:43.029161 bus /gobi_4: Setting Powered False 06:42:44.127620 bus /gobi_4: Setting Powered False 06:42:45.242476 bus /gobi_1: Setting Powered False 06:42:46.343424 bus /gobi_1: Setting Powered False 06:42:47.462266 bus /gobi_0: Setting Powered False 06:42:48.560914 bus /gobi_0: Setting Powered False 06:42:49.674968 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 06:42:50.778060 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:50.790732 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:42:50.845924 tst ping.py: using LAC 39112 06:42:50.966614 tst ping.py: using RAC 97 06:42:51.088385 tst ping.py: using CellId 39112 06:42:51.207853 tst ping.py: using BVCI 39113 06:42:51.328761 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.341048 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.353075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.365507 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.377307 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.389502 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.401619 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:51.413425 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:51.530446 tst ping.py:19: start network... 06:42:51.736821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:52.213424 run create_hlr_db(pid=19014): Launched 06:42:52.330614 bus /gobi_6: Setting Powered False 06:42:53.391345 run create_hlr_db(pid=19014): Terminated: ok {rc=0} 06:42:53.839944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19016): Launched 06:42:54.167033 run osmo-hlr_10.42.42.2(pid=19017): Launched 06:42:54.291962 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:54.858243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19019): Launched 06:42:55.187233 run osmo-stp_10.42.42.5(pid=19020): Launched 06:42:55.313706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:42:55.881046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19022): Launched 06:42:56.006473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:42:56.283371 run patchelf(pid=19023): Launched 06:42:56.466507 run osmo-stp_10.42.42.5(pid=19020): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19020)] 06:42:56.604656 run osmo-stp_10.42.42.5(pid=19020): stdout: | (launched: 2022-12-14_06:42:55.127079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:56.744442 run osmo-stp_10.42.42.5(pid=19020): stderr: | 20221214064255320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064255320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064255320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064255321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064255321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064255321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064255321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:56.884688 run osmo-stp_10.42.42.5(pid=19020): stdout: | (launched: 2022-12-14_06:42:55.127079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:57.018901 run osmo-stp_10.42.42.5(pid=19020): stderr: | 20221214064255320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064255320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064255320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064255321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064255321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064255321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064255321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:57.177532 run patchelf(pid=19023): Terminating (SIGINT) 06:42:57.359927 run patchelf(pid=19023): Terminated: ok {rc=0} 06:42:57.491671 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19020): Process ended prematurely: osmo-stp_10.42.42.5(pid=19020) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19020)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 06:42:57.502022 tst ping.py:22: Test FAILED (6.7 sec) 06:42:57.530855 run osmo-hlr_10.42.42.2(pid=19017): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19017)] 06:42:57.581934 run osmo-hlr_10.42.42.2(pid=19017): stdout: | (launched: 2022-12-14_06:42:54.107398) 06:42:57.634122 run osmo-hlr_10.42.42.2(pid=19017): stderr: | 20221214064254305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064254305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064254305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064254306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064254306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064254306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064254318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064254326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064254326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064254327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:57.687007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19016): Terminating (SIGTERM) 06:42:57.729069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19019): Terminating (SIGTERM) 06:42:57.771058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19022): Terminating (SIGTERM) 06:42:57.813600 --- ParallelTerminationStrategy: PID 19016 died... 06:42:57.833854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19016): Terminated: ok {rc=0} 06:42:57.880584 --- ParallelTerminationStrategy: PID 19019 died... 06:42:57.900323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19019): Terminated: ok {rc=0} 06:42:57.946760 --- ParallelTerminationStrategy: PID 19022 died... 06:42:57.966561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19022): Terminated: ok {rc=0} 06:42:58.054981 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 06:42:59.142738 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.155093 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:42:59.213425 tst ping_idle_ping.py: using LAC 39113 06:42:59.343646 tst ping_idle_ping.py: using RAC 98 06:42:59.471316 tst ping_idle_ping.py: using CellId 39113 06:42:59.592501 tst ping_idle_ping.py: using BVCI 39114 06:42:59.704551 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.716240 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.727477 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.738935 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.750683 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.762198 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.773932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:42:59.785571 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:42:59.906594 tst ping_idle_ping.py:24: start network... 06:43:00.130205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:43:00.642146 run create_hlr_db(pid=19024): Launched 06:43:00.776214 bus /gobi_6: Setting Powered False 06:43:01.861898 run create_hlr_db(pid=19024): Terminated: ok {rc=0} 06:43:02.309960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19026): Launched 06:43:02.630570 run osmo-hlr_10.42.42.2(pid=19027): Launched 06:43:02.752837 run osmo-stp_10.42.42.5: Starting osmo-stp 06:43:03.295329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19029): Launched 06:43:03.604418 run osmo-stp_10.42.42.5(pid=19030): Launched 06:43:03.723623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:43:04.258505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19032): Launched 06:43:04.376394 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:43:04.638030 run patchelf(pid=19033): Launched 06:43:04.810735 run osmo-stp_10.42.42.5(pid=19030): ERR: Terminated: ERROR {rc=1} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19030)] 06:43:04.940631 run osmo-stp_10.42.42.5(pid=19030): stdout: | (launched: 2022-12-14_06:43:03.547061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:43:05.072257 run osmo-stp_10.42.42.5(pid=19030): stderr: | 20221214064303719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064303719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064303719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064303719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064303720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064303720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064303720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:43:05.203925 run osmo-stp_10.42.42.5(pid=19030): stdout: | (launched: 2022-12-14_06:43:03.547061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:43:05.329421 run osmo-stp_10.42.42.5(pid=19030): stderr: | 20221214064303719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064303719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064303719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064303719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064303720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064303720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064303720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:43:05.478087 run patchelf(pid=19033): Terminating (SIGINT) 06:43:05.650435 run patchelf(pid=19033): Terminated: ok {rc=0} 06:43:05.774610 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19030): Process ended prematurely: osmo-stp_10.42.42.5(pid=19030) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19030)] [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 06:43:05.783798 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:43:05.810556 run osmo-hlr_10.42.42.2(pid=19027): ERR: Terminated: ERROR {rc=237} [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19027)] 06:43:05.858214 run osmo-hlr_10.42.42.2(pid=19027): stdout: | (launched: 2022-12-14_06:43:02.573113) 06:43:05.907631 run osmo-hlr_10.42.42.2(pid=19027): stderr: | 20221214064302753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064302753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064302753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064302753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064302753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064302753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064302766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064302774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064302774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064302774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:05.957484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19026): Terminating (SIGTERM) 06:43:05.997289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19029): Terminating (SIGTERM) 06:43:06.036942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19032): Terminating (SIGTERM) 06:43:06.077081 --- ParallelTerminationStrategy: PID 19026 died... 06:43:06.096282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19026): Terminated: ok {rc=0} 06:43:06.140264 --- ParallelTerminationStrategy: PID 19029 died... 06:43:06.159104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19029): Terminated: ok {rc=0} 06:43:06.202700 --- ParallelTerminationStrategy: PID 19032 died... 06:43:06.221464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19032): Terminated: ok {rc=0} 06:43:06.304825 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 06:43:07.617261 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:43:07.624746 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:43:07.656374 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:43:07.691197 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:43:07.743102 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:43:07.774810 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:43:07.809499 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:43:08.370897 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2400 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:43:08.376281 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:08.388006 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:43:08.456032 tst switch_tch_pdch.py: using LAC 39114 06:43:08.578341 tst switch_tch_pdch.py: using RAC 99 06:43:08.699785 tst switch_tch_pdch.py: using CellId 39114 06:43:08.822428 tst switch_tch_pdch.py: using BVCI 39115 06:43:08.934093 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:08.945800 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:08.957409 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:08.968937 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:08.981420 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:08.994029 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:09.006513 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:43:09.019000 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:43:09.142232 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:43:09.261755 tst switch_tch_pdch.py:51: start network... 06:43:09.468650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:43:09.944371 run create_hlr_db(pid=19037): Launched 06:43:10.061228 bus /gobi_6: Setting Powered False 06:43:11.122190 run create_hlr_db(pid=19037): Terminated: ok {rc=0} 06:43:11.548143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19039): Launched 06:43:11.854533 run osmo-hlr_10.42.42.2(pid=19040): Launched 06:43:11.974398 run osmo-stp_10.42.42.5: Starting osmo-stp 06:43:12.507718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19042): Launched 06:43:12.814932 run osmo-stp_10.42.42.5(pid=19043): Launched 06:43:12.932813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:43:13.463950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19045): Launched 06:43:13.581611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:43:13.842146 run patchelf(pid=19046): Launched 06:43:14.012283 run osmo-stp_10.42.42.5(pid=19043): ERR: Terminated: ERROR {rc=1} [trial-2400↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19043)] 06:43:14.142688 run osmo-stp_10.42.42.5(pid=19043): stdout: | (launched: 2022-12-14_06:43:12.758654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:43:14.274750 run osmo-stp_10.42.42.5(pid=19043): stderr: | 20221214064312930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064312930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064312930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064312931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064312931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064312931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064312931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:43:14.406533 run osmo-stp_10.42.42.5(pid=19043): stdout: | (launched: 2022-12-14_06:43:12.758654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:43:14.532099 run osmo-stp_10.42.42.5(pid=19043): stderr: | 20221214064312930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064312930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064312930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064312931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064312931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064312931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064312931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:43:14.681355 run patchelf(pid=19046): Terminating (SIGINT) 06:43:14.853104 run patchelf(pid=19046): Terminated: ok {rc=0} 06:43:14.976781 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19043): Process ended prematurely: osmo-stp_10.42.42.5(pid=19043) [trial-2400↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19043)] [trial-2400↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:43:14.985945 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 06:43:15.012409 run osmo-hlr_10.42.42.2(pid=19040): ERR: Terminated: ERROR {rc=237} [trial-2400↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19040)] 06:43:15.060221 run osmo-hlr_10.42.42.2(pid=19040): stdout: | (launched: 2022-12-14_06:43:11.798226) 06:43:15.109509 run osmo-hlr_10.42.42.2(pid=19040): stderr: | 20221214064311976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064311976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064311976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064311976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064311976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064311976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064311988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064311996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064311997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064311997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:15.159106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19039): Terminating (SIGTERM) 06:43:15.199142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19042): Terminating (SIGTERM) 06:43:15.239014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19045): Terminating (SIGTERM) 06:43:15.278888 --- ParallelTerminationStrategy: PID 19039 died... 06:43:15.298125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19039): Terminated: ok {rc=0} 06:43:15.342086 --- ParallelTerminationStrategy: PID 19042 died... 06:43:15.360676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19042): Terminated: ok {rc=0} 06:43:15.404855 --- ParallelTerminationStrategy: PID 19045 died... 06:43:15.423984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19045): Terminated: ok {rc=0} 06:43:15.510249 bus /gobi_0: Setting Powered False 06:43:16.608358 bus /gobi_0: Setting Powered False 06:43:17.722905 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2400 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 nitb_smpp --------------------------------------------------------------------- 06:43:18.975464 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:43:18.978020 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 06:43:18.998394 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 06:43:19.005101 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 06:43:19.038881 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 06:43:19.059655 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 06:43:19.066260 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 06:43:19.589909 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2400 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 06:43:19.595168 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:43:19.615321 tst esme_connect_policy_acceptall.py: using MSISDN 8543 06:43:19.762068 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:43:20.385909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19050): Launched 06:43:20.721754 run osmo-nitb_10.42.42.2(pid=19051): Launched 06:43:20.906503 run osmo-nitb_10.42.42.2(pid=19051): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19051)] 06:43:21.055320 run osmo-nitb_10.42.42.2(pid=19051): stdout: | (launched: 2022-12-14_06:43:20.661122) 06:43:21.205455 run osmo-nitb_10.42.42.2(pid=19051): stderr: | (launched: 2022-12-14_06:43:20.710784) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:21.355408 run osmo-nitb_10.42.42.2(pid=19051): stdout: | (launched: 2022-12-14_06:43:20.661122) 06:43:21.499437 run osmo-nitb_10.42.42.2(pid=19051): stderr: | (launched: 2022-12-14_06:43:20.710784) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19051): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19051) [trial-2400↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19051)] 06:43:21.848311 tst osmo-nitb_10.42.42.2(pid=19051): stdout: | (launched: 2022-12-14_06:43:20.661122) 06:43:21.982977 tst osmo-nitb_10.42.42.2(pid=19051): stderr: | (launched: 2022-12-14_06:43:20.710784) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:22.142713 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=19051): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19051) [trial-2400↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19051)] [trial-2400↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 06:43:22.151858 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 06:43:22.158952 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19050): Terminating (SIGTERM) 06:43:22.369449 --- ParallelTerminationStrategy: PID 19050 died... 06:43:22.391376 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19050): Terminated: ok {rc=0} ---------------------------------------------- trial-2400 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 06:43:22.442262 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:43:22.464282 tst esme_connect_policy_closed.py: using MSISDN 8544 06:43:22.597832 tst esme_connect_policy_closed.py: using MSISDN 8545 06:43:22.719103 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:43:23.341797 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19052): Launched 06:43:23.677968 run osmo-nitb_10.42.42.2(pid=19053): Launched 06:43:23.859294 run osmo-nitb_10.42.42.2(pid=19053): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19053)] 06:43:23.996813 run osmo-nitb_10.42.42.2(pid=19053): stdout: | (launched: 2022-12-14_06:43:23.616048) 06:43:24.135667 run osmo-nitb_10.42.42.2(pid=19053): stderr: | (launched: 2022-12-14_06:43:23.666322) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:24.274480 run osmo-nitb_10.42.42.2(pid=19053): stdout: | (launched: 2022-12-14_06:43:23.616048) 06:43:24.407741 run osmo-nitb_10.42.42.2(pid=19053): stderr: | (launched: 2022-12-14_06:43:23.666322) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:24.566932 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=19053): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19053) [trial-2400↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19053)] [trial-2400↪nitb_smpp↪esme_connect_policy_closed.py:24] 06:43:24.575935 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 06:43:24.583061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19052): Terminating (SIGTERM) 06:43:24.793275 --- ParallelTerminationStrategy: PID 19052 died... 06:43:24.814380 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19052): Terminated: ok {rc=0} ---------------------------------------------- trial-2400 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 06:43:24.864885 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:43:24.876762 tst nitb_smpp: Using 1 x bts (candidates: 1) 06:43:24.915950 tst esme_ms_sms_storeforward.py: using LAC 39115 06:43:25.049301 tst esme_ms_sms_storeforward.py: using RAC 100 06:43:25.179818 tst esme_ms_sms_storeforward.py: using CellId 39115 06:43:25.310378 tst esme_ms_sms_storeforward.py: using BVCI 39116 06:43:25.434971 tst nitb_smpp: Using 1 x modem (candidates: 1) 06:43:25.561389 tst esme_ms_sms_storeforward.py: using MSISDN 8546 06:43:25.676261 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 06:43:25.890955 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:43:26.535781 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19054): Launched 06:43:26.853647 run osmo-nitb_10.42.42.2(pid=19055): Launched 06:43:27.024617 run osmo-nitb_10.42.42.2(pid=19055): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19055)] 06:43:27.154973 run osmo-nitb_10.42.42.2(pid=19055): stdout: | (launched: 2022-12-14_06:43:26.795709) 06:43:27.285776 run osmo-nitb_10.42.42.2(pid=19055): stderr: | (launched: 2022-12-14_06:43:26.842829) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:27.416918 run osmo-nitb_10.42.42.2(pid=19055): stdout: | (launched: 2022-12-14_06:43:26.795709) 06:43:27.543007 run osmo-nitb_10.42.42.2(pid=19055): stderr: | (launched: 2022-12-14_06:43:26.842829) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:27.693341 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=19055): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19055) [trial-2400↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19055)] [trial-2400↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 06:43:27.701816 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 06:43:27.708315 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19054): Terminating (SIGTERM) 06:43:27.916635 --- ParallelTerminationStrategy: PID 19054 died... 06:43:27.937087 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19054): Terminated: ok {rc=0} 06:43:28.021142 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 06:43:29.107283 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:43:29.119217 tst nitb_smpp: Using 1 x bts (candidates: 1) 06:43:29.155328 tst esme_ms_sms_transaction.py: using LAC 39116 06:43:29.282040 tst esme_ms_sms_transaction.py: using RAC 101 06:43:29.408037 tst esme_ms_sms_transaction.py: using CellId 39116 06:43:29.533846 tst esme_ms_sms_transaction.py: using BVCI 39117 06:43:29.651274 tst nitb_smpp: Using 1 x modem (candidates: 1) 06:43:29.783764 tst esme_ms_sms_transaction.py: using MSISDN 8547 06:43:29.907106 tst esme_ms_sms_transaction.py:18: start nitb and bts... 06:43:30.135994 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:43:30.814979 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19056): Launched 06:43:31.165123 run osmo-nitb_10.42.42.2(pid=19057): Launched 06:43:31.373183 run osmo-nitb_10.42.42.2(pid=19057): ERR: Terminated: ERROR {rc=2} [trial-2400↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19057)] 06:43:31.526275 run osmo-nitb_10.42.42.2(pid=19057): stdout: | (launched: 2022-12-14_06:43:31.100529) 06:43:31.680316 run osmo-nitb_10.42.42.2(pid=19057): stderr: | (launched: 2022-12-14_06:43:31.151678) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:31.834293 run osmo-nitb_10.42.42.2(pid=19057): stdout: | (launched: 2022-12-14_06:43:31.100529) 06:43:31.981645 run osmo-nitb_10.42.42.2(pid=19057): stderr: | (launched: 2022-12-14_06:43:31.151678) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbb04b28268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19057): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19057) [trial-2400↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19057)] 06:43:32.313212 tst osmo-nitb_10.42.42.2(pid=19057): stdout: | (launched: 2022-12-14_06:43:31.100529) 06:43:32.448023 tst osmo-nitb_10.42.42.2(pid=19057): stderr: | (launched: 2022-12-14_06:43:31.151678) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:43:32.607842 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=19057): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19057) [trial-2400↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19057)] [trial-2400↪nitb_smpp↪esme_ms_sms_transaction.py:21] 06:43:32.617119 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 06:43:32.624099 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19056): Terminating (SIGTERM) 06:43:32.834515 --- ParallelTerminationStrategy: PID 19056 died... 06:43:32.856153 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19056): Terminated: ok {rc=0} 06:43:32.943771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 smpp --------------------------------------------------------------------- 06:43:34.112713 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:43:34.116007 tst smpp: Verifying 1 x bts (candidates: 11) 06:43:34.137173 tst smpp: Verifying 6 x ip_address (candidates: 9) 06:43:34.164570 tst smpp: Verifying 1 x modem (candidates: 12) 06:43:34.202468 tst smpp: Reserving 1 x bts (candidates: 11) 06:43:34.223699 tst smpp: Reserving 6 x ip_address (candidates: 9) 06:43:34.250327 tst smpp: Reserving 1 x modem (candidates: 12) 06:43:34.776909 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 06:43:34.782334 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:34.793529 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:34.804380 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:34.815314 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:34.834632 tst esme_connect_policy_acceptall.py: using MSISDN 8548 06:43:34.956510 run osmo-stp_10.42.42.4: Starting osmo-stp 06:43:35.530051 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19062): Launched 06:43:35.865427 run osmo-stp_10.42.42.4(pid=19063): Launched 06:43:35.994502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:43:36.515544 run create_hlr_db(pid=19064): Launched 06:43:36.650867 bus /sierra_2: Setting Powered False 06:43:37.716253 run create_hlr_db(pid=19064): Terminated: ok {rc=0} 06:43:38.166253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19066): Launched 06:43:38.483237 run osmo-hlr_10.42.42.2(pid=19067): Launched 06:43:38.605179 run osmo-msc_10.42.42.5: Starting osmo-msc 06:43:39.190789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19069): Launched 06:43:39.508239 run osmo-msc_10.42.42.5(pid=19070): Launched 06:43:39.685940 run osmo-hlr_10.42.42.2(pid=19067): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)] 06:43:39.825663 run osmo-hlr_10.42.42.2(pid=19067): stdout: | (launched: 2022-12-14_06:43:38.425122) 06:43:39.969438 run osmo-hlr_10.42.42.2(pid=19067): stderr: | 20221214064338602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064338602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064338614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064338624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064338624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064338624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:40.109245 run osmo-hlr_10.42.42.2(pid=19067): stdout: | (launched: 2022-12-14_06:43:38.425122) 06:43:40.242872 run osmo-hlr_10.42.42.2(pid=19067): stderr: | 20221214064338602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064338602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064338602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064338614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064338624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064338624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064338624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:40.402055 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=19067): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19067) [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)] [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23] 06:43:40.410859 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 06:43:40.438104 run osmo-msc_10.42.42.5(pid=19070): ERR: Terminated: ERROR {rc=9} [trial-2400↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=19070)] 06:43:40.488015 run osmo-msc_10.42.42.5(pid=19070): stdout: | (launched: 2022-12-14_06:43:39.449842) 06:43:40.539617 run osmo-msc_10.42.42.5(pid=19070): stderr: | 20221214064339763 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214064339763 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214064339763 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064339764 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214064339764 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214064339764 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214064339764 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214064339764 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214064339764 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 06:43:40.591613 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19062): Terminating (SIGTERM) 06:43:40.633050 run osmo-stp_10.42.42.4(pid=19063): Terminating (SIGTERM) 06:43:40.674555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19066): Terminating (SIGTERM) 06:43:40.717566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19069): Terminating (SIGTERM) 06:43:40.762179 --- ParallelTerminationStrategy: PID 19062 died... 06:43:40.783181 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19062): Terminated: ok {rc=0} 06:43:40.832780 --- ParallelTerminationStrategy: PID 19063 died... 06:43:40.853275 run osmo-stp_10.42.42.4(pid=19063): Terminated: ok {rc=0} 06:43:40.899307 --- ParallelTerminationStrategy: PID 19066 died... 06:43:40.918819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19066): Terminated: ok {rc=0} 06:43:40.965040 --- ParallelTerminationStrategy: PID 19069 died... 06:43:40.985026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19069): Terminated: ok {rc=0} ---------------------------------------------- trial-2400 smpp esme_connect_policy_closed.py ---------------------------------------------- 06:43:41.036211 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:41.048256 tst smpp: Using 1 x bts (candidates: 1) 06:43:41.084172 tst esme_connect_policy_closed.py: using LAC 39117 06:43:41.210250 tst esme_connect_policy_closed.py: using RAC 102 06:43:41.335955 tst esme_connect_policy_closed.py: using CellId 39117 06:43:41.460660 tst esme_connect_policy_closed.py: using BVCI 39118 06:43:41.577224 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:41.587720 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:41.598176 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:41.617732 tst esme_connect_policy_closed.py: using MSISDN 8549 06:43:41.742685 tst esme_connect_policy_closed.py: using MSISDN 8550 06:43:41.859052 run osmo-stp_10.42.42.4: Starting osmo-stp 06:43:42.399058 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19073): Launched 06:43:42.716458 run osmo-stp_10.42.42.4(pid=19074): Launched 06:43:42.839809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:43:43.332045 run create_hlr_db(pid=19075): Launched 06:43:44.509619 run create_hlr_db(pid=19075): Terminated: ok {rc=0} 06:43:44.844141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19077): Launched 06:43:45.160863 run osmo-hlr_10.42.42.2(pid=19078): Launched 06:43:45.281853 run osmo-msc_10.42.42.5: Starting osmo-msc 06:43:45.881666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19080): Launched 06:43:46.244737 run osmo-msc_10.42.42.5(pid=19081): Launched 06:43:46.541427 run osmo-hlr_10.42.42.2(pid=19078): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)] 06:43:46.780930 run osmo-hlr_10.42.42.2(pid=19078): stdout: | (launched: 2022-12-14_06:43:45.102613) 06:43:47.088922 run osmo-hlr_10.42.42.2(pid=19078): stderr: | 20221214064345277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064345277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064345289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064345297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064345297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064345297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:47.232819 run osmo-hlr_10.42.42.2(pid=19078): stdout: | (launched: 2022-12-14_06:43:45.102613) 06:43:47.367201 run osmo-hlr_10.42.42.2(pid=19078): stderr: | 20221214064345277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064345277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064345277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064345289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064345297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064345297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064345297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:47.527480 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=19078): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19078) [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)] [trial-2400↪smpp↪esme_connect_policy_closed.py:31] 06:43:47.536577 tst esme_connect_policy_closed.py:31: Test FAILED (6.5 sec) 06:43:47.564197 run osmo-msc_10.42.42.5(pid=19081): ERR: Terminated: ERROR {rc=9} [trial-2400↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=19081)] 06:43:47.615158 run osmo-msc_10.42.42.5(pid=19081): stdout: | (launched: 2022-12-14_06:43:46.182588) 06:43:47.667114 run osmo-msc_10.42.42.5(pid=19081): stderr: | 20221214064346817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214064346817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214064346817 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064346817 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214064346817 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214064346817 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214064346817 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214064346818 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214064346818 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 06:43:47.719248 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19073): Terminating (SIGTERM) 06:43:47.761152 run osmo-stp_10.42.42.4(pid=19074): Terminating (SIGTERM) 06:43:47.803722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19077): Terminating (SIGTERM) 06:43:47.847862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19080): Terminating (SIGTERM) 06:43:47.892704 --- ParallelTerminationStrategy: PID 19073 died... 06:43:47.913551 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19073): Terminated: ok {rc=0} 06:43:47.961693 --- ParallelTerminationStrategy: PID 19074 died... 06:43:47.981508 run osmo-stp_10.42.42.4(pid=19074): Terminated: ok {rc=0} 06:43:48.028461 --- ParallelTerminationStrategy: PID 19077 died... 06:43:48.048135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19077): Terminated: ok {rc=0} 06:43:48.094974 --- ParallelTerminationStrategy: PID 19080 died... 06:43:48.114758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19080): Terminated: ok {rc=0} ---------------------------------------------- trial-2400 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 06:43:48.166031 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:48.177867 tst smpp: Using 1 x bts (candidates: 1) 06:43:48.216628 tst esme_ms_sms_storeforward.py: using LAC 39118 06:43:48.342619 tst esme_ms_sms_storeforward.py: using RAC 103 06:43:48.465408 tst esme_ms_sms_storeforward.py: using CellId 39118 06:43:48.588759 tst esme_ms_sms_storeforward.py: using BVCI 39119 06:43:48.704826 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:48.715439 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:48.726126 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:48.736401 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:48.746841 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:48.758383 tst smpp: Using 1 x modem (candidates: 1) 06:43:48.891592 tst esme_ms_sms_storeforward.py: using MSISDN 8551 06:43:49.015714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:43:49.539733 run create_hlr_db(pid=19084): Launched 06:43:50.736416 run create_hlr_db(pid=19084): Terminated: ok {rc=0} 06:43:51.092626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Launched 06:43:51.432679 run osmo-hlr_10.42.42.2(pid=19087): Launched 06:43:51.564258 run osmo-stp_10.42.42.5: Starting osmo-stp 06:43:52.157145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Launched 06:43:52.498370 run osmo-stp_10.42.42.5(pid=19090): Launched 06:43:52.628546 run osmo-msc_10.42.42.6: Starting osmo-msc 06:43:53.240636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Launched 06:43:53.578334 run osmo-msc_10.42.42.6(pid=19093): Launched 06:43:53.766607 run osmo-stp_10.42.42.5(pid=19090): ERR: Terminated: ERROR {rc=1} [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] 06:43:53.908655 run osmo-stp_10.42.42.5(pid=19090): stdout: | (launched: 2022-12-14_06:43:52.435585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:43:54.051591 run osmo-stp_10.42.42.5(pid=19090): stderr: | 20221214064352632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064352632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064352632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064352633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064352633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064352633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064352633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:43:54.192187 run osmo-stp_10.42.42.5(pid=19090): stdout: | (launched: 2022-12-14_06:43:52.435585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:43:54.326965 run osmo-stp_10.42.42.5(pid=19090): stderr: | 20221214064352632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064352632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064352632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064352633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064352633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064352633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064352633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:43:54.487673 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30] 06:43:54.496652 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 06:43:54.524044 run osmo-hlr_10.42.42.2(pid=19087): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19087)] 06:43:54.574356 run osmo-hlr_10.42.42.2(pid=19087): stdout: | (launched: 2022-12-14_06:43:51.370796) 06:43:54.626978 run osmo-hlr_10.42.42.2(pid=19087): stderr: | 20221214064351572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064351572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064351572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064351572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064351572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064351572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064351585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064351594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064351594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064351594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:43:54.699782 run osmo-msc_10.42.42.6(pid=19093): ERR: Terminated: ERROR {rc=2} [trial-2400↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19093)] 06:43:54.750003 run osmo-msc_10.42.42.6(pid=19093): stdout: | (launched: 2022-12-14_06:43:53.515834) 06:43:54.802181 run osmo-msc_10.42.42.6(pid=19093): stderr: | 20221214064353841 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064353841 DLGLOBAL DEBUG validating counter group 0x7f3d87667c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064353841 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064353841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064353841 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064353842 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064353845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064353846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064353846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064353846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:43:54.854479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminating (SIGTERM) 06:43:54.896550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminating (SIGTERM) 06:43:54.938626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminating (SIGTERM) 06:43:54.980839 --- ParallelTerminationStrategy: PID 19086 died... 06:43:55.000569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminated: ok {rc=0} 06:43:55.046994 --- ParallelTerminationStrategy: PID 19089 died... 06:43:55.066465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminated: ok {rc=0} 06:43:55.112670 --- ParallelTerminationStrategy: PID 19092 died... 06:43:55.132297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminated: ok {rc=0} 06:43:55.221280 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 smpp esme_ms_sms_transaction.py ---------------------------------------------- 06:43:56.307823 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:56.319687 tst smpp: Using 1 x bts (candidates: 1) 06:43:56.354941 tst esme_ms_sms_transaction.py: using LAC 39119 06:43:56.488515 tst esme_ms_sms_transaction.py: using RAC 104 06:43:56.621429 tst esme_ms_sms_transaction.py: using CellId 39119 06:43:56.754929 tst esme_ms_sms_transaction.py: using BVCI 39120 06:43:56.879644 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:56.890627 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:56.901483 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:56.912283 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:56.923183 tst smpp: Using 1 x ip_address (candidates: 6) 06:43:56.934069 tst smpp: Using 1 x modem (candidates: 1) 06:43:57.067162 tst esme_ms_sms_transaction.py: using MSISDN 8552 06:43:57.191974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:43:57.715552 run create_hlr_db(pid=19095): Launched 06:43:57.852517 bus /sierra_2: Setting Powered False 06:43:58.919029 run create_hlr_db(pid=19095): Terminated: ok {rc=0} 06:43:59.389100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Launched 06:43:59.727530 run osmo-hlr_10.42.42.2(pid=19098): Launched 06:43:59.858932 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:00.443763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Launched 06:44:00.779754 run osmo-stp_10.42.42.5(pid=19101): Launched 06:44:00.910662 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:01.696390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Launched 06:44:02.049365 run osmo-msc_10.42.42.6(pid=19104): Launched 06:44:02.484087 run osmo-stp_10.42.42.5(pid=19101): ERR: Terminated: ERROR {rc=1} [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] 06:44:02.617621 run osmo-stp_10.42.42.5(pid=19101): stdout: | (launched: 2022-12-14_06:44:00.718430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:02.749270 run osmo-stp_10.42.42.5(pid=19101): stderr: | 20221214064401000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064401000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064401000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064401001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064401001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064401001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064401001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:02.881123 run osmo-stp_10.42.42.5(pid=19101): stdout: | (launched: 2022-12-14_06:44:00.718430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:03.007115 run osmo-stp_10.42.42.5(pid=19101): stderr: | 20221214064401000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064401000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064401000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064401001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064401001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064401001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064401001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:03.158065 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] [trial-2400↪smpp↪esme_ms_sms_transaction.py:28] 06:44:03.166546 tst esme_ms_sms_transaction.py:28: Test FAILED (6.9 sec) 06:44:03.192563 run osmo-hlr_10.42.42.2(pid=19098): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19098)] 06:44:03.241509 run osmo-hlr_10.42.42.2(pid=19098): stdout: | (launched: 2022-12-14_06:43:59.665723) 06:44:03.291318 run osmo-hlr_10.42.42.2(pid=19098): stderr: | 20221214064359867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064359867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064359867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064359867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064359867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064359867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064359880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064359890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064359890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064359890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:03.361134 run osmo-msc_10.42.42.6(pid=19104): ERR: Terminated: ERROR {rc=2} [trial-2400↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19104)] 06:44:03.408758 run osmo-msc_10.42.42.6(pid=19104): stdout: | (launched: 2022-12-14_06:44:01.985997) 06:44:03.458713 run osmo-msc_10.42.42.6(pid=19104): stderr: | 20221214064402301 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064402301 DLGLOBAL DEBUG validating counter group 0x7fe1c6b96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064402301 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064402302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064402302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064402302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064402305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064402306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064402306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064402306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:03.509007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminating (SIGTERM) 06:44:03.549343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminating (SIGTERM) 06:44:03.589597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Terminating (SIGTERM) 06:44:03.629964 --- ParallelTerminationStrategy: PID 19097 died... 06:44:03.649529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminated: ok {rc=0} 06:44:03.694213 --- ParallelTerminationStrategy: PID 19100 died... 06:44:03.713161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminated: ok {rc=0} 06:44:03.757415 --- ParallelTerminationStrategy: PID 19103 died... 06:44:03.776330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Terminated: ok {rc=0} 06:44:03.863714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 encryption --------------------------------------------------------------------- 06:44:05.051898 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:44:05.054885 tst encryption: Verifying 1 x bts (candidates: 11) 06:44:05.075488 tst encryption: Verifying 6 x ip_address (candidates: 9) 06:44:05.102406 tst encryption: Verifying 1 x modem (candidates: 12) 06:44:05.137522 tst encryption: Reserving 1 x bts (candidates: 11) 06:44:05.158449 tst encryption: Reserving 6 x ip_address (candidates: 9) 06:44:05.184894 tst encryption: Reserving 1 x modem (candidates: 12) 06:44:05.713333 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2400 encryption register_a5_0_authopt.py ---------------------------------------------- 06:44:05.767111 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:05.777893 tst encryption: Using 1 x bts (candidates: 1) 06:44:05.813433 tst register_a5_0_authopt.py: using LAC 39120 06:44:05.945454 tst register_a5_0_authopt.py: using RAC 105 06:44:06.070392 tst register_a5_0_authopt.py: using CellId 39120 06:44:06.200123 tst register_a5_0_authopt.py: using BVCI 39121 06:44:06.316321 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:06.327029 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:06.337576 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:06.348024 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:06.358829 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:06.369894 tst encryption: Using 1 x modem (candidates: 1) 06:44:06.491185 tst register_a5_0_authopt.py:8: start network... 06:44:06.724829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:44:07.256206 run create_hlr_db(pid=19109): Launched 06:44:07.379768 bus /sierra_2: Setting Powered False 06:44:08.442114 run create_hlr_db(pid=19109): Terminated: ok {rc=0} 06:44:08.886989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Launched 06:44:09.207890 run osmo-hlr_10.42.42.2(pid=19112): Launched 06:44:09.330023 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:09.895217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Launched 06:44:10.216810 run osmo-stp_10.42.42.5(pid=19115): Launched 06:44:10.339808 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:10.914158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19117): Launched 06:44:11.233349 run osmo-msc_10.42.42.6(pid=19118): Launched 06:44:11.411761 run osmo-stp_10.42.42.5(pid=19115): ERR: Terminated: ERROR {rc=1} [trial-2400↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] 06:44:11.547606 run osmo-stp_10.42.42.5(pid=19115): stdout: | (launched: 2022-12-14_06:44:10.157428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:11.681945 run osmo-stp_10.42.42.5(pid=19115): stderr: | 20221214064410330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064410331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064410331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064410331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064410332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064410332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064410332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:11.814673 run osmo-stp_10.42.42.5(pid=19115): stdout: | (launched: 2022-12-14_06:44:10.157428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:11.942555 run osmo-stp_10.42.42.5(pid=19115): stderr: | 20221214064410330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064410331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064410331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064410331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064410332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064410332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064410332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:12.094416 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19115): Process ended prematurely: osmo-stp_10.42.42.5(pid=19115) [trial-2400↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] [trial-2400↪encryption↪register_a5_0_authopt.py:8] 06:44:12.103512 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 06:44:12.129617 run osmo-hlr_10.42.42.2(pid=19112): ERR: Terminated: ERROR {rc=237} [trial-2400↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19112)] 06:44:12.177699 run osmo-hlr_10.42.42.2(pid=19112): stdout: | (launched: 2022-12-14_06:44:09.148847) 06:44:12.226856 run osmo-hlr_10.42.42.2(pid=19112): stderr: | 20221214064409328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064409328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064409328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064409328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064409328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064409328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064409340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064409349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064409349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064409349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:12.295768 run osmo-msc_10.42.42.6(pid=19118): ERR: Terminated: ERROR {rc=2} [trial-2400↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19118)] 06:44:12.343048 run osmo-msc_10.42.42.6(pid=19118): stdout: | (launched: 2022-12-14_06:44:11.174518) 06:44:12.392886 run osmo-msc_10.42.42.6(pid=19118): stderr: | 20221214064411447 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064411447 DLGLOBAL DEBUG validating counter group 0x7fbace6a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064411447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064411447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064411447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064411448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064411451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064411451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064411452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064411452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:12.442540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Terminating (SIGTERM) 06:44:12.482525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Terminating (SIGTERM) 06:44:12.522518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19117): Terminating (SIGTERM) 06:44:12.562592 --- ParallelTerminationStrategy: PID 19111 died... 06:44:12.582175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Terminated: ok {rc=0} 06:44:12.626384 --- ParallelTerminationStrategy: PID 19114 died... 06:44:12.645455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Terminated: ok {rc=0} 06:44:12.689265 --- ParallelTerminationStrategy: PID 19117 died... 06:44:12.708007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19117): Terminated: ok {rc=0} 06:44:12.791248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 encryption register_a5_0_authreq.py ---------------------------------------------- 06:44:13.944170 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:13.956156 tst encryption: Using 1 x bts (candidates: 1) 06:44:13.993088 tst register_a5_0_authreq.py: using LAC 39121 06:44:14.124177 tst register_a5_0_authreq.py: using RAC 106 06:44:14.249486 tst register_a5_0_authreq.py: using CellId 39121 06:44:14.382845 tst register_a5_0_authreq.py: using BVCI 39122 06:44:14.508459 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:14.519773 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:14.531084 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:14.542245 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:14.553263 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:14.564338 tst encryption: Using 1 x modem (candidates: 1) 06:44:14.684413 tst register_a5_0_authreq.py:8: start network... 06:44:14.902205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:44:15.398244 run create_hlr_db(pid=19120): Launched 06:44:15.521774 bus /sierra_2: Setting Powered False 06:44:16.590041 run create_hlr_db(pid=19120): Terminated: ok {rc=0} 06:44:17.069869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19122): Launched 06:44:17.406387 run osmo-hlr_10.42.42.2(pid=19123): Launched 06:44:17.531983 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:18.101842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19125): Launched 06:44:18.422136 run osmo-stp_10.42.42.5(pid=19126): Launched 06:44:18.544574 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:19.120305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19128): Launched 06:44:19.440074 run osmo-msc_10.42.42.6(pid=19129): Launched 06:44:19.618442 run osmo-stp_10.42.42.5(pid=19126): ERR: Terminated: ERROR {rc=1} [trial-2400↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19126)] 06:44:19.753229 run osmo-stp_10.42.42.5(pid=19126): stdout: | (launched: 2022-12-14_06:44:18.362951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:19.887639 run osmo-stp_10.42.42.5(pid=19126): stderr: | 20221214064418537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064418538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064418538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064418538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064418539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064418539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064418539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:20.020171 run osmo-stp_10.42.42.5(pid=19126): stdout: | (launched: 2022-12-14_06:44:18.362951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:20.147378 run osmo-stp_10.42.42.5(pid=19126): stderr: | 20221214064418537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064418538 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064418538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064418538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064418539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064418539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064418539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:20.299615 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19126): Process ended prematurely: osmo-stp_10.42.42.5(pid=19126) [trial-2400↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19126)] [trial-2400↪encryption↪register_a5_0_authreq.py:8] 06:44:20.308894 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 06:44:20.335296 run osmo-hlr_10.42.42.2(pid=19123): ERR: Terminated: ERROR {rc=237} [trial-2400↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19123)] 06:44:20.383485 run osmo-hlr_10.42.42.2(pid=19123): stdout: | (launched: 2022-12-14_06:44:17.347413) 06:44:20.433064 run osmo-hlr_10.42.42.2(pid=19123): stderr: | 20221214064417527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064417527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064417527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064417527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064417527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064417527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064417539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064417547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064417547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064417547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:20.502321 run osmo-msc_10.42.42.6(pid=19129): ERR: Terminated: ERROR {rc=2} [trial-2400↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19129)] 06:44:20.549844 run osmo-msc_10.42.42.6(pid=19129): stdout: | (launched: 2022-12-14_06:44:19.381132) 06:44:20.599384 run osmo-msc_10.42.42.6(pid=19129): stderr: | 20221214064419656 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064419656 DLGLOBAL DEBUG validating counter group 0x7f9aea875c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064419656 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064419657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064419657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064419657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064419659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064419659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064419659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064419659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:20.649233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19122): Terminating (SIGTERM) 06:44:20.689283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19125): Terminating (SIGTERM) 06:44:20.729387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19128): Terminating (SIGTERM) 06:44:20.769730 --- ParallelTerminationStrategy: PID 19122 died... 06:44:20.789417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19122): Terminated: ok {rc=0} 06:44:20.834099 --- ParallelTerminationStrategy: PID 19125 died... 06:44:20.853397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19125): Terminated: ok {rc=0} 06:44:20.897837 --- ParallelTerminationStrategy: PID 19128 died... 06:44:20.917010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19128): Terminated: ok {rc=0} 06:44:21.001609 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 encryption register_a5_1_authreq.py ---------------------------------------------- 06:44:22.155617 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:22.167975 tst encryption: Using 1 x bts (candidates: 1) 06:44:22.204906 tst register_a5_1_authreq.py: using LAC 39122 06:44:22.339963 tst register_a5_1_authreq.py: using RAC 107 06:44:22.475588 tst register_a5_1_authreq.py: using CellId 39122 06:44:22.610995 tst register_a5_1_authreq.py: using BVCI 39123 06:44:22.734973 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:22.746078 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:22.757070 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:22.767925 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:22.779320 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:22.790715 tst encryption: Using 1 x modem (candidates: 1) 06:44:22.912321 tst register_a5_1_authreq.py:8: start network... 06:44:23.146413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:44:23.675813 run create_hlr_db(pid=19131): Launched 06:44:23.813697 bus /sierra_2: Setting Powered False 06:44:24.880413 run create_hlr_db(pid=19131): Terminated: ok {rc=0} 06:44:25.335925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19133): Launched 06:44:25.657499 run osmo-hlr_10.42.42.2(pid=19134): Launched 06:44:25.780361 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:26.347623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19136): Launched 06:44:26.668240 run osmo-stp_10.42.42.5(pid=19137): Launched 06:44:26.791487 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:27.367984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19139): Launched 06:44:27.688168 run osmo-msc_10.42.42.6(pid=19140): Launched 06:44:27.866436 run osmo-stp_10.42.42.5(pid=19137): ERR: Terminated: ERROR {rc=1} [trial-2400↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19137)] 06:44:28.001238 run osmo-stp_10.42.42.5(pid=19137): stdout: | (launched: 2022-12-14_06:44:26.609209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:28.135896 run osmo-stp_10.42.42.5(pid=19137): stderr: | 20221214064426783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064426783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064426784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064426784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064426784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064426785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064426785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:28.268909 run osmo-stp_10.42.42.5(pid=19137): stdout: | (launched: 2022-12-14_06:44:26.609209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:28.396427 run osmo-stp_10.42.42.5(pid=19137): stderr: | 20221214064426783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064426783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064426784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064426784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064426784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064426785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064426785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:28.548856 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19137): Process ended prematurely: osmo-stp_10.42.42.5(pid=19137) [trial-2400↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19137)] [trial-2400↪encryption↪register_a5_1_authreq.py:8] 06:44:28.558151 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 06:44:28.584455 run osmo-hlr_10.42.42.2(pid=19134): ERR: Terminated: ERROR {rc=237} [trial-2400↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19134)] 06:44:28.632719 run osmo-hlr_10.42.42.2(pid=19134): stdout: | (launched: 2022-12-14_06:44:25.598332) 06:44:28.682300 run osmo-hlr_10.42.42.2(pid=19134): stderr: | 20221214064425778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064425778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064425778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064425778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064425778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064425778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064425791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064425799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064425799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064425800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:28.751885 run osmo-msc_10.42.42.6(pid=19140): ERR: Terminated: ERROR {rc=2} [trial-2400↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19140)] 06:44:28.799457 run osmo-msc_10.42.42.6(pid=19140): stdout: | (launched: 2022-12-14_06:44:27.629236) 06:44:28.849278 run osmo-msc_10.42.42.6(pid=19140): stderr: | 20221214064427903 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064427903 DLGLOBAL DEBUG validating counter group 0x7f597935ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064427903 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064427903 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064427903 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064427904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064427905 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064427906 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064427906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064427906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:28.899372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19133): Terminating (SIGTERM) 06:44:28.939701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19136): Terminating (SIGTERM) 06:44:28.979998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19139): Terminating (SIGTERM) 06:44:29.020855 --- ParallelTerminationStrategy: PID 19133 died... 06:44:29.040683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19133): Terminated: ok {rc=0} 06:44:29.085168 --- ParallelTerminationStrategy: PID 19136 died... 06:44:29.104304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19136): Terminated: ok {rc=0} 06:44:29.148424 --- ParallelTerminationStrategy: PID 19139 died... 06:44:29.167697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19139): Terminated: ok {rc=0} 06:44:29.254704 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2400 encryption register_a5_3_authreq.py ---------------------------------------------- 06:44:30.404584 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:30.416403 tst encryption: Using 1 x bts (candidates: 1) 06:44:30.451967 tst register_a5_3_authreq.py: using LAC 39123 06:44:30.579807 tst register_a5_3_authreq.py: using RAC 108 06:44:30.706903 tst register_a5_3_authreq.py: using CellId 39123 06:44:30.839099 tst register_a5_3_authreq.py: using BVCI 39124 06:44:30.967045 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:30.978940 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:30.990909 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:31.002763 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:31.015698 tst encryption: Using 1 x ip_address (candidates: 6) 06:44:31.028595 tst encryption: Using 1 x modem (candidates: 1) 06:44:31.164590 tst register_a5_3_authreq.py:8: start network... 06:44:31.388325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:44:31.894371 run create_hlr_db(pid=19142): Launched 06:44:32.066824 bus /sierra_2: Setting Powered False 06:44:33.133472 run create_hlr_db(pid=19142): Terminated: ok {rc=0} 06:44:33.593015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19144): Launched 06:44:33.915224 run osmo-hlr_10.42.42.2(pid=19145): Launched 06:44:34.040571 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:34.605106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19147): Launched 06:44:34.925395 run osmo-stp_10.42.42.5(pid=19148): Launched 06:44:35.048215 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:35.624746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19150): Launched 06:44:35.944668 run osmo-msc_10.42.42.6(pid=19151): Launched 06:44:36.123971 run osmo-stp_10.42.42.5(pid=19148): ERR: Terminated: ERROR {rc=1} [trial-2400↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19148)] 06:44:36.259418 run osmo-stp_10.42.42.5(pid=19148): stdout: | (launched: 2022-12-14_06:44:34.866636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:36.395061 run osmo-stp_10.42.42.5(pid=19148): stderr: | 20221214064435042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064435042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064435043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064435043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064435043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064435043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064435044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:36.528016 run osmo-stp_10.42.42.5(pid=19148): stdout: | (launched: 2022-12-14_06:44:34.866636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:36.656199 run osmo-stp_10.42.42.5(pid=19148): stderr: | 20221214064435042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064435042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064435043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064435043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064435043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064435043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064435044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:36.808747 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19148): Process ended prematurely: osmo-stp_10.42.42.5(pid=19148) [trial-2400↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19148)] [trial-2400↪encryption↪register_a5_3_authreq.py:8] 06:44:36.818107 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 06:44:36.844523 run osmo-hlr_10.42.42.2(pid=19145): ERR: Terminated: ERROR {rc=237} [trial-2400↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19145)] 06:44:36.892681 run osmo-hlr_10.42.42.2(pid=19145): stdout: | (launched: 2022-12-14_06:44:33.856362) 06:44:36.942139 run osmo-hlr_10.42.42.2(pid=19145): stderr: | 20221214064434035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064434035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064434035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064434036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064434036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064434036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064434047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064434056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064434056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064434056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:37.011208 run osmo-msc_10.42.42.6(pid=19151): ERR: Terminated: ERROR {rc=2} [trial-2400↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19151)] 06:44:37.058224 run osmo-msc_10.42.42.6(pid=19151): stdout: | (launched: 2022-12-14_06:44:35.886112) 06:44:37.107435 run osmo-msc_10.42.42.6(pid=19151): stderr: | 20221214064436159 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064436160 DLGLOBAL DEBUG validating counter group 0x7fd8a3efec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064436160 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064436160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064436160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064436160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064436162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064436162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064436162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064436163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:37.157080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19144): Terminating (SIGTERM) 06:44:37.196902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19147): Terminating (SIGTERM) 06:44:37.236904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19150): Terminating (SIGTERM) 06:44:37.277152 --- ParallelTerminationStrategy: PID 19144 died... 06:44:37.296594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19144): Terminated: ok {rc=0} 06:44:37.340589 --- ParallelTerminationStrategy: PID 19147 died... 06:44:37.359595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19147): Terminated: ok {rc=0} 06:44:37.403482 --- ParallelTerminationStrategy: PID 19150 died... 06:44:37.422605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19150): Terminated: ok {rc=0} 06:44:37.506110 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 06:44:38.717284 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:44:38.723175 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 06:44:38.742290 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 06:44:38.770359 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 06:44:38.797124 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 06:44:38.815611 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 06:44:38.842543 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 06:44:39.355236 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 06:44:39.360284 tst handover.py:11: TEST_CONFIG: {} 06:44:39.591258 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:44:39.607850 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:44:39.631647 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:44:39.683848 tst handover.py: using MSISDN 8553 06:44:39.809650 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8553', subscriber_id=0} 06:44:39.927887 run srsepc_10.42.42.118: Starting srsepc 06:44:41.870924 run rm-remote-dir(pid=19157): Launched 06:44:42.007494 bus /sierra_2: Setting Powered False 06:44:43.078368 run rm-remote-dir(pid=19157): Terminated: ok {rc=0} 06:44:43.565103 run mk-remote-dir(pid=19158): Launched 06:44:44.765142 run mk-remote-dir(pid=19158): Terminated: ok {rc=0} 06:44:45.081962 run scp-inst-to-remote(pid=19159): Launched 06:44:47.277948 run scp-inst-to-remote(pid=19159): Terminated: ok {rc=0} 06:44:47.659547 run rm-remote-dir(pid=19161): Launched 06:44:48.859426 run rm-remote-dir(pid=19161): Terminated: ok {rc=0} 06:44:49.231306 run mk-remote-dir(pid=19162): Launched 06:44:50.430873 run mk-remote-dir(pid=19162): Terminated: ok {rc=0} 06:44:50.747273 run scp-cfg-to-remote(pid=19163): Launched 06:44:51.944113 run scp-cfg-to-remote(pid=19163): Terminated: ok {rc=0} 06:44:52.258964 run scp-db-to-remote(pid=19165): Launched 06:44:53.455305 run scp-db-to-remote(pid=19165): Terminated: ok {rc=0} 06:44:53.600118 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:44:53.942825 run patchelf(pid=19167): Launched 06:44:55.138498 run patchelf(pid=19167): Terminated: ok {rc=0} 06:44:55.283021 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:44:55.627340 run setcap-netadm(pid=19168): Launched 06:44:56.823350 run setcap-netadm(pid=19168): Terminated: ok {rc=0} 06:44:57.181128 run srsepc(pid=19169): Launched 06:44:57.308301 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:44:58.528902 run rm-remote-dir(pid=19170): Launched 06:44:58.727356 run srsepc(pid=19169): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19169)] 06:44:58.877159 run srsepc(pid=19169): stdout: | (launched: 2022-12-14_06:44:57.118463) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:59.026505 run srsepc(pid=19169): stderr: | (launched: 2022-12-14_06:44:57.168896) | Connection to 10.42.42.116 closed. 06:44:59.176064 run srsepc(pid=19169): stdout: | (launched: 2022-12-14_06:44:57.118463) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:59.318984 run srsepc(pid=19169): stderr: | (launched: 2022-12-14_06:44:57.168896) | Connection to 10.42.42.116 closed. 06:44:59.488178 run rm-remote-dir(pid=19170): Terminating (SIGINT) 06:44:59.683344 run rm-remote-dir(pid=19170): Terminated: ok {rc=0} 06:44:59.824857 tst handover.py:37: ERR: Error: srsepc(pid=19169): Process ended prematurely: srsepc(pid=19169) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19169)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 06:44:59.835683 tst handover.py:37: Test FAILED (20.5 sec) 06:44:59.917393 run scp-back-log(pid=19171): Launched 06:45:00.998589 run scp-back-log(pid=19171): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19171)] 06:45:01.065312 run scp-back-log(pid=19171): stdout: | (launched: 2022-12-14_06:44:59.884729) 06:45:01.133230 run scp-back-log(pid=19171): stderr: | (launched: 2022-12-14_06:44:59.905563) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:45:01.209173 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19171): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19171)]') ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 06:45:01.258849 tst iperf3_bidir.py:13: Number of physical ue: 1 06:45:01.495624 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:45:01.540112 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 06:45:01.781172 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:45:01.798279 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:45:01.831761 tst iperf3_bidir.py: using MSISDN 8554 06:45:01.959247 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8554', subscriber_id=0} 06:45:02.082981 run srsepc_10.42.42.118: Starting srsepc 06:45:02.784659 run rm-remote-dir(pid=19176): Launched 06:45:03.986071 run rm-remote-dir(pid=19176): Terminated: ok {rc=0} 06:45:04.357298 run mk-remote-dir(pid=19177): Launched 06:45:05.556055 run mk-remote-dir(pid=19177): Terminated: ok {rc=0} 06:45:05.872423 run scp-inst-to-remote(pid=19178): Launched 06:45:08.072120 run scp-inst-to-remote(pid=19178): Terminated: ok {rc=0} 06:45:08.441867 run rm-remote-dir(pid=19180): Launched 06:45:09.636846 run rm-remote-dir(pid=19180): Terminated: ok {rc=0} 06:45:09.986889 run mk-remote-dir(pid=19181): Launched 06:45:11.173028 run mk-remote-dir(pid=19181): Terminated: ok {rc=0} 06:45:11.474188 run scp-cfg-to-remote(pid=19182): Launched 06:45:12.672909 run scp-cfg-to-remote(pid=19182): Terminated: ok {rc=0} 06:45:12.987322 run scp-db-to-remote(pid=19184): Launched 06:45:14.184124 run scp-db-to-remote(pid=19184): Terminated: ok {rc=0} 06:45:14.328406 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:45:14.670888 run patchelf(pid=19186): Launched 06:45:15.870802 run patchelf(pid=19186): Terminated: ok {rc=0} 06:45:16.030869 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:45:16.382123 run setcap-netadm(pid=19187): Launched 06:45:17.642126 run setcap-netadm(pid=19187): Terminated: ok {rc=0} 06:45:17.998787 run srsepc(pid=19188): Launched 06:45:18.127109 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:45:19.346585 run rm-remote-dir(pid=19189): Launched 06:45:19.544082 run srsepc(pid=19188): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19188)] 06:45:19.693507 run srsepc(pid=19188): stdout: | (launched: 2022-12-14_06:45:17.936445) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:45:19.842382 run srsepc(pid=19188): stderr: | (launched: 2022-12-14_06:45:17.987032) | Connection to 10.42.42.116 closed. 06:45:19.991080 run srsepc(pid=19188): stdout: | (launched: 2022-12-14_06:45:17.936445) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:45:20.133963 run srsepc(pid=19188): stderr: | (launched: 2022-12-14_06:45:17.987032) | Connection to 10.42.42.116 closed. 06:45:20.302947 run rm-remote-dir(pid=19189): Terminating (SIGINT) 06:45:20.498271 run rm-remote-dir(pid=19189): Terminated: ok {rc=0} 06:45:20.639471 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=19188): Process ended prematurely: srsepc(pid=19188) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19188)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 06:45:20.650840 tst iperf3_bidir.py:42: Test FAILED (19.4 sec) 06:45:20.732540 run scp-back-log(pid=19190): Launched 06:45:21.813252 run scp-back-log(pid=19190): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19190)] 06:45:21.877098 run scp-back-log(pid=19190): stdout: | (launched: 2022-12-14_06:45:20.699856) 06:45:21.942452 run scp-back-log(pid=19190): stderr: | (launched: 2022-12-14_06:45:20.720808) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:45:22.015913 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19190): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19190)]') ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 06:45:22.063563 tst iperf3_dl.py:13: Number of physical ue: 1 06:45:22.294814 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:45:22.340238 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 06:45:22.556014 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:45:22.572117 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:45:22.604741 tst iperf3_dl.py: using MSISDN 8555 06:45:22.728936 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8555', subscriber_id=0} 06:45:22.847554 run srsepc_10.42.42.118: Starting srsepc 06:45:23.543392 run rm-remote-dir(pid=19192): Launched 06:45:24.741732 run rm-remote-dir(pid=19192): Terminated: ok {rc=0} 06:45:25.112409 run mk-remote-dir(pid=19193): Launched 06:45:26.311382 run mk-remote-dir(pid=19193): Terminated: ok {rc=0} 06:45:26.627346 run scp-inst-to-remote(pid=19194): Launched 06:45:28.820879 run scp-inst-to-remote(pid=19194): Terminated: ok {rc=0} 06:45:29.168098 run rm-remote-dir(pid=19196): Launched 06:45:30.353239 run rm-remote-dir(pid=19196): Terminated: ok {rc=0} 06:45:30.701956 run mk-remote-dir(pid=19197): Launched 06:45:31.914031 run mk-remote-dir(pid=19197): Terminated: ok {rc=0} 06:45:32.245531 run scp-cfg-to-remote(pid=19198): Launched 06:45:33.428269 run scp-cfg-to-remote(pid=19198): Terminated: ok {rc=0} 06:45:33.724138 run scp-db-to-remote(pid=19200): Launched 06:45:34.907161 run scp-db-to-remote(pid=19200): Terminated: ok {rc=0} 06:45:35.043573 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:45:35.364606 run patchelf(pid=19202): Launched 06:45:36.546830 run patchelf(pid=19202): Terminated: ok {rc=0} 06:45:36.683428 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:45:37.005556 run setcap-netadm(pid=19203): Launched 06:45:38.190521 run setcap-netadm(pid=19203): Terminated: ok {rc=0} 06:45:38.526649 run srsepc(pid=19204): Launched 06:45:38.646021 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:45:39.797660 run rm-remote-dir(pid=19205): Launched 06:45:39.981241 run srsepc(pid=19204): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19204)] 06:45:40.121246 run srsepc(pid=19204): stdout: | (launched: 2022-12-14_06:45:38.467804) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:45:40.261578 run srsepc(pid=19204): stderr: | (launched: 2022-12-14_06:45:38.515083) | Connection to 10.42.42.116 closed. 06:45:40.401754 run srsepc(pid=19204): stdout: | (launched: 2022-12-14_06:45:38.467804) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:45:40.535870 run srsepc(pid=19204): stderr: | (launched: 2022-12-14_06:45:38.515083) | Connection to 10.42.42.116 closed. 06:45:40.694696 run rm-remote-dir(pid=19205): Terminating (SIGINT) 06:45:40.879491 run rm-remote-dir(pid=19205): Terminated: ok {rc=0} 06:45:41.012583 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=19204): Process ended prematurely: srsepc(pid=19204) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19204)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 06:45:41.023028 tst iperf3_dl.py:42: Test FAILED (19.0 sec) 06:45:41.101883 run scp-back-log(pid=19206): Launched 06:45:42.178578 run scp-back-log(pid=19206): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19206)] 06:45:42.239504 run scp-back-log(pid=19206): stdout: | (launched: 2022-12-14_06:45:41.070652) 06:45:42.301878 run scp-back-log(pid=19206): stderr: | (launched: 2022-12-14_06:45:41.090453) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:45:42.372078 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19206): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19206)]') ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 06:45:42.417524 tst iperf3_ul.py:13: Number of physical ue: 1 06:45:42.634791 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:45:42.677824 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 06:45:42.908848 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:45:42.925658 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:45:42.959076 tst iperf3_ul.py: using MSISDN 8556 06:45:43.076374 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8556', subscriber_id=0} 06:45:43.188480 run srsepc_10.42.42.118: Starting srsepc 06:45:43.842746 run rm-remote-dir(pid=19208): Launched 06:45:45.029036 run rm-remote-dir(pid=19208): Terminated: ok {rc=0} 06:45:45.377849 run mk-remote-dir(pid=19209): Launched 06:45:46.577871 run mk-remote-dir(pid=19209): Terminated: ok {rc=0} 06:45:46.939776 run scp-inst-to-remote(pid=19210): Launched 06:45:49.150874 run scp-inst-to-remote(pid=19210): Terminated: ok {rc=0} 06:45:49.497483 run rm-remote-dir(pid=19212): Launched 06:45:50.682452 run rm-remote-dir(pid=19212): Terminated: ok {rc=0} 06:45:51.031400 run mk-remote-dir(pid=19213): Launched 06:45:52.217521 run mk-remote-dir(pid=19213): Terminated: ok {rc=0} 06:45:52.514721 run scp-cfg-to-remote(pid=19217): Launched 06:45:53.696880 run scp-cfg-to-remote(pid=19217): Terminated: ok {rc=0} 06:45:53.992167 run scp-db-to-remote(pid=19219): Launched 06:45:55.174650 run scp-db-to-remote(pid=19219): Terminated: ok {rc=0} 06:45:55.310715 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:45:55.631712 run patchelf(pid=19221): Launched 06:45:56.814760 run patchelf(pid=19221): Terminated: ok {rc=0} 06:45:56.950737 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:45:57.272625 run setcap-netadm(pid=19222): Launched 06:45:58.454561 run setcap-netadm(pid=19222): Terminated: ok {rc=0} 06:45:58.790505 run srsepc(pid=19223): Launched 06:45:58.910919 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:46:00.060241 run rm-remote-dir(pid=19224): Launched 06:46:00.243978 run srsepc(pid=19223): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19223)] 06:46:00.383686 run srsepc(pid=19223): stdout: | (launched: 2022-12-14_06:45:58.731495) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:46:00.523850 run srsepc(pid=19223): stderr: | (launched: 2022-12-14_06:45:58.778700) | Connection to 10.42.42.116 closed. 06:46:00.664078 run srsepc(pid=19223): stdout: | (launched: 2022-12-14_06:45:58.731495) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:46:00.799076 run srsepc(pid=19223): stderr: | (launched: 2022-12-14_06:45:58.778700) | Connection to 10.42.42.116 closed. 06:46:00.984846 run rm-remote-dir(pid=19224): Terminating (SIGINT) 06:46:01.174607 run rm-remote-dir(pid=19224): Terminated: ok {rc=0} 06:46:01.310730 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=19223): Process ended prematurely: srsepc(pid=19223) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19223)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 06:46:01.321654 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 06:46:01.409212 run scp-back-log(pid=19225): Launched 06:46:02.522660 run scp-back-log(pid=19225): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19225)] 06:46:02.583596 run scp-back-log(pid=19225): stdout: | (launched: 2022-12-14_06:46:01.369683) 06:46:02.645989 run scp-back-log(pid=19225): stderr: | (launched: 2022-12-14_06:46:01.389616) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:46:02.715904 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19225): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19225)]') ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 06:46:02.762187 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:46:02.779262 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:46:02.802408 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:46:02.851637 tst ping.py: using MSISDN 8557 06:46:02.971353 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8557', subscriber_id=0} 06:46:03.084491 run srsepc_10.42.42.118: Starting srsepc 06:46:03.740691 run rm-remote-dir(pid=19227): Launched 06:46:04.925592 run rm-remote-dir(pid=19227): Terminated: ok {rc=0} 06:46:05.274614 run mk-remote-dir(pid=19228): Launched 06:46:06.459741 run mk-remote-dir(pid=19228): Terminated: ok {rc=0} 06:46:06.757448 run scp-inst-to-remote(pid=19229): Launched 06:46:08.944906 run scp-inst-to-remote(pid=19229): Terminated: ok {rc=0} 06:46:09.314543 run rm-remote-dir(pid=19231): Launched 06:46:10.510276 run rm-remote-dir(pid=19231): Terminated: ok {rc=0} 06:46:10.858144 run mk-remote-dir(pid=19232): Launched 06:46:12.043905 run mk-remote-dir(pid=19232): Terminated: ok {rc=0} 06:46:12.341284 run scp-cfg-to-remote(pid=19233): Launched 06:46:13.523395 run scp-cfg-to-remote(pid=19233): Terminated: ok {rc=0} 06:46:13.818371 run scp-db-to-remote(pid=19235): Launched 06:46:15.004794 run scp-db-to-remote(pid=19235): Terminated: ok {rc=0} 06:46:15.141595 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:46:15.462876 run patchelf(pid=19237): Launched 06:46:16.659265 run patchelf(pid=19237): Terminated: ok {rc=0} 06:46:16.803240 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:46:17.136665 run setcap-netadm(pid=19238): Launched 06:46:18.359355 run setcap-netadm(pid=19238): Terminated: ok {rc=0} 06:46:18.694767 run srsepc(pid=19239): Launched 06:46:18.813110 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:46:20.028814 run rm-remote-dir(pid=19240): Launched 06:46:20.221026 run srsepc(pid=19239): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19239)] 06:46:20.369783 run srsepc(pid=19239): stdout: | (launched: 2022-12-14_06:46:18.635524) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:46:20.518580 run srsepc(pid=19239): stderr: | (launched: 2022-12-14_06:46:18.682882) | Connection to 10.42.42.116 closed. 06:46:20.667531 run srsepc(pid=19239): stdout: | (launched: 2022-12-14_06:46:18.635524) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:46:20.810171 run srsepc(pid=19239): stderr: | (launched: 2022-12-14_06:46:18.682882) | Connection to 10.42.42.116 closed. 06:46:20.979243 run rm-remote-dir(pid=19240): Terminating (SIGINT) 06:46:21.175347 run rm-remote-dir(pid=19240): Terminated: ok {rc=0} 06:46:21.316671 tst ping.py:16: ERR: Error: srsepc(pid=19239): Process ended prematurely: srsepc(pid=19239) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19239)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 06:46:21.327820 tst ping.py:16: Test FAILED (18.6 sec) 06:46:21.410006 run scp-back-log(pid=19241): Launched 06:46:22.490451 run scp-back-log(pid=19241): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19241)] 06:46:22.553814 run scp-back-log(pid=19241): stdout: | (launched: 2022-12-14_06:46:21.376648) 06:46:22.618763 run scp-back-log(pid=19241): stderr: | (launched: 2022-12-14_06:46:21.397391) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:46:22.691718 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19241): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19241)]') ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 06:46:22.739792 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:46:22.757386 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:46:22.780758 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:46:22.832039 tst rrc_idle_mo_ping.py: using MSISDN 8558 06:46:22.950249 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8558', subscriber_id=0} 06:46:23.061667 run srsepc_10.42.42.118: Starting srsepc 06:46:23.715227 run rm-remote-dir(pid=19243): Launched 06:46:24.902537 run rm-remote-dir(pid=19243): Terminated: ok {rc=0} 06:46:25.252389 run mk-remote-dir(pid=19244): Launched 06:46:26.437570 run mk-remote-dir(pid=19244): Terminated: ok {rc=0} 06:46:26.735153 run scp-inst-to-remote(pid=19245): Launched 06:46:28.919756 run scp-inst-to-remote(pid=19245): Terminated: ok {rc=0} 06:46:29.267513 run rm-remote-dir(pid=19247): Launched 06:46:30.452882 run rm-remote-dir(pid=19247): Terminated: ok {rc=0} 06:46:30.801529 run mk-remote-dir(pid=19248): Launched 06:46:32.028024 run mk-remote-dir(pid=19248): Terminated: ok {rc=0} 06:46:32.375734 run scp-cfg-to-remote(pid=19249): Launched 06:46:33.559941 run scp-cfg-to-remote(pid=19249): Terminated: ok {rc=0} 06:46:33.855487 run scp-db-to-remote(pid=19251): Launched 06:46:35.039249 run scp-db-to-remote(pid=19251): Terminated: ok {rc=0} 06:46:35.175528 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:46:35.498408 run patchelf(pid=19253): Launched 06:46:36.679475 run patchelf(pid=19253): Terminated: ok {rc=0} 06:46:36.815792 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:46:37.137430 run setcap-netadm(pid=19254): Launched 06:46:38.319964 run setcap-netadm(pid=19254): Terminated: ok {rc=0} 06:46:38.655281 run srsepc(pid=19255): Launched 06:46:38.773446 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:46:39.925787 run rm-remote-dir(pid=19256): Launched 06:46:40.123164 run srsepc(pid=19255): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19255)] 06:46:40.272857 run srsepc(pid=19255): stdout: | (launched: 2022-12-14_06:46:38.596700) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:46:40.422108 run srsepc(pid=19255): stderr: | (launched: 2022-12-14_06:46:38.643867) | Connection to 10.42.42.116 closed. 06:46:40.571366 run srsepc(pid=19255): stdout: | (launched: 2022-12-14_06:46:38.596700) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:46:40.714040 run srsepc(pid=19255): stderr: | (launched: 2022-12-14_06:46:38.643867) | Connection to 10.42.42.116 closed. 06:46:40.883258 run rm-remote-dir(pid=19256): Terminating (SIGINT) 06:46:41.078974 run rm-remote-dir(pid=19256): Terminated: ok {rc=0} 06:46:41.221095 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=19255): Process ended prematurely: srsepc(pid=19255) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19255)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 06:46:41.232091 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 06:46:41.314448 run scp-back-log(pid=19257): Launched 06:46:42.396032 run scp-back-log(pid=19257): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19257)] 06:46:42.460365 run scp-back-log(pid=19257): stdout: | (launched: 2022-12-14_06:46:41.281318) 06:46:42.526349 run scp-back-log(pid=19257): stderr: | (launched: 2022-12-14_06:46:41.302293) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:46:42.600039 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19257): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19257)]') ---------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 06:46:42.648630 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:46:42.666207 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:46:42.689863 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:46:42.738353 tst rrc_idle_mt_ping.py: using MSISDN 8559 06:46:42.863465 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8559', subscriber_id=0} 06:46:42.981994 run srsepc_10.42.42.118: Starting srsepc 06:46:43.677814 run rm-remote-dir(pid=19259): Launched 06:46:44.877374 run rm-remote-dir(pid=19259): Terminated: ok {rc=0} 06:46:45.248787 run mk-remote-dir(pid=19260): Launched 06:46:46.445495 run mk-remote-dir(pid=19260): Terminated: ok {rc=0} 06:46:46.752643 run scp-inst-to-remote(pid=19261): Launched 06:46:48.999333 run scp-inst-to-remote(pid=19261): Terminated: ok {rc=0} 06:46:49.346815 run rm-remote-dir(pid=19263): Launched 06:46:50.533605 run rm-remote-dir(pid=19263): Terminated: ok {rc=0} 06:46:50.882967 run mk-remote-dir(pid=19264): Launched 06:46:52.068859 run mk-remote-dir(pid=19264): Terminated: ok {rc=0} 06:46:52.366945 run scp-cfg-to-remote(pid=19265): Launched 06:46:53.549534 run scp-cfg-to-remote(pid=19265): Terminated: ok {rc=0} 06:46:53.845575 run scp-db-to-remote(pid=19267): Launched 06:46:55.029202 run scp-db-to-remote(pid=19267): Terminated: ok {rc=0} 06:46:55.165660 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:46:55.489074 run patchelf(pid=19269): Launched 06:46:56.673852 run patchelf(pid=19269): Terminated: ok {rc=0} 06:46:56.810826 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:46:57.134115 run setcap-netadm(pid=19270): Launched 06:46:58.317804 run setcap-netadm(pid=19270): Terminated: ok {rc=0} 06:46:58.654275 run srsepc(pid=19271): Launched 06:46:58.772874 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:46:59.922457 run rm-remote-dir(pid=19272): Launched 06:47:00.105741 run srsepc(pid=19271): ERR: Terminated: ERROR {rc=127} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19271)] 06:47:00.245422 run srsepc(pid=19271): stdout: | (launched: 2022-12-14_06:46:58.595220) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:47:00.385876 run srsepc(pid=19271): stderr: | (launched: 2022-12-14_06:46:58.642550) | Connection to 10.42.42.116 closed. 06:47:00.526064 run srsepc(pid=19271): stdout: | (launched: 2022-12-14_06:46:58.595220) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:47:00.660884 run srsepc(pid=19271): stderr: | (launched: 2022-12-14_06:46:58.642550) | Connection to 10.42.42.116 closed. 06:47:00.820728 run rm-remote-dir(pid=19272): Terminating (SIGINT) 06:47:01.041987 run rm-remote-dir(pid=19272): Terminated: ok {rc=0} 06:47:01.186494 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=19271): Process ended prematurely: srsepc(pid=19271) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19271)] [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 06:47:01.199335 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 06:47:01.285156 run scp-back-log(pid=19273): Launched 06:47:02.405864 run scp-back-log(pid=19273): ERR: Terminated: ERROR {rc=1} [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19273)] 06:47:02.469544 run scp-back-log(pid=19273): stdout: | (launched: 2022-12-14_06:47:01.249803) 06:47:02.534510 run scp-back-log(pid=19273): stderr: | (launched: 2022-12-14_06:47:01.270889) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:47:02.608247 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19273): launch_sync(): local process exited with status 1 [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19273)]') --------------------------------------------------------------------- trial-2400 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 06:47:02.741655 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:02.747029 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 06:47:02.789294 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 06:47:02.815660 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 06:47:02.868771 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 06:47:02.912371 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 06:47:02.939648 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 06:47:03.488013 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 06:47:03.493984 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:47:03.505527 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 06:47:03.545966 tst handover.py: using LAC 39124 06:47:03.679427 tst handover.py: using RAC 109 06:47:03.809206 tst handover.py: using CellId 39124 06:47:03.939072 tst handover.py: using BVCI 39125 06:47:04.061098 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 06:47:04.095000 tst handover.py: using LAC 39125 06:47:04.229421 tst handover.py: using RAC 110 06:47:04.360106 tst handover.py: using CellId 39125 06:47:04.491087 tst handover.py: using BVCI 39126 06:47:04.613123 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:47:04.624463 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:47:04.635574 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:47:04.646699 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:47:04.657987 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:47:04.669251 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 06:47:04.788064 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 06:47:04.909629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:05.431259 run create_hlr_db(pid=19280): Launched 06:47:06.619080 run create_hlr_db(pid=19280): Terminated: ok {rc=0} 06:47:06.972931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19282): Launched 06:47:07.309097 run osmo-hlr_10.42.42.2(pid=19283): Launched 06:47:07.437399 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:08.020686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19285): Launched 06:47:08.356466 run osmo-stp_10.42.42.5(pid=19286): Launched 06:47:08.486127 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:09.093249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19288): Launched 06:47:09.429190 run osmo-msc_10.42.42.6(pid=19289): Launched 06:47:09.616279 run osmo-stp_10.42.42.5(pid=19286): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19286)] 06:47:09.756406 run osmo-stp_10.42.42.5(pid=19286): stdout: | (launched: 2022-12-14_06:47:08.294887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:09.897283 run osmo-stp_10.42.42.5(pid=19286): stderr: | 20221214064708492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064708492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064708492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064708493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064708493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064708493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064708493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:10.037175 run osmo-stp_10.42.42.5(pid=19286): stdout: | (launched: 2022-12-14_06:47:08.294887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:10.170674 run osmo-stp_10.42.42.5(pid=19286): stderr: | 20221214064708492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064708492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064708492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064708493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064708493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064708493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064708493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:10.330238 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19286): Process ended prematurely: osmo-stp_10.42.42.5(pid=19286) [trial-2400↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19286)] [trial-2400↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 06:47:10.339386 tst handover.py:18: Test FAILED (6.8 sec) 06:47:10.367080 run osmo-hlr_10.42.42.2(pid=19283): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19283)] 06:47:10.417495 run osmo-hlr_10.42.42.2(pid=19283): stdout: | (launched: 2022-12-14_06:47:07.247616) 06:47:10.469865 run osmo-hlr_10.42.42.2(pid=19283): stderr: | 20221214064707449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064707450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064707450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064707450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064707450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064707450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064707462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064707470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064707471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064707471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:10.542753 run osmo-msc_10.42.42.6(pid=19289): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19289)] 06:47:10.593178 run osmo-msc_10.42.42.6(pid=19289): stdout: | (launched: 2022-12-14_06:47:09.367246) 06:47:10.645242 run osmo-msc_10.42.42.6(pid=19289): stderr: | 20221214064709693 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064709693 DLGLOBAL DEBUG validating counter group 0x7f3569705c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064709693 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064709693 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064709693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064709693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064709695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064709695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064709695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064709696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:10.697551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19282): Terminating (SIGTERM) 06:47:10.739605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19285): Terminating (SIGTERM) 06:47:10.781664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19288): Terminating (SIGTERM) 06:47:10.824050 --- ParallelTerminationStrategy: PID 19282 died... 06:47:10.844073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19282): Terminated: ok {rc=0} 06:47:10.890777 --- ParallelTerminationStrategy: PID 19285 died... 06:47:10.910682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19285): Terminated: ok {rc=0} 06:47:10.957182 --- ParallelTerminationStrategy: PID 19288 died... 06:47:10.977258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19288): Terminated: ok {rc=0} 06:47:11.065914 bus /sierra_3: Setting Powered False 06:47:12.162071 bus /sierra_3: Setting Powered False 06:47:13.278966 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 06:47:14.528408 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:14.534053 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 06:47:14.574562 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 06:47:14.601940 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 06:47:14.654671 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 06:47:14.695515 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 06:47:14.722956 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 06:47:15.276573 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 06:47:15.283059 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:47:15.295000 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 06:47:15.332493 tst handover.py: using LAC 39126 06:47:15.463794 tst handover.py: using RAC 111 06:47:15.594421 tst handover.py: using CellId 39126 06:47:15.727382 tst handover.py: using BVCI 39127 06:47:15.860607 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 06:47:15.895851 tst handover.py: using LAC 39127 06:47:16.034680 tst handover.py: using RAC 112 06:47:16.161789 tst handover.py: using CellId 39127 06:47:16.337385 tst handover.py: using BVCI 39128 06:47:16.463075 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:47:16.475016 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:47:16.486995 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:47:16.499003 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:47:16.511062 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:47:16.523055 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 06:47:16.646079 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 06:47:16.770107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:17.250477 run create_hlr_db(pid=19294): Launched 06:47:17.383832 bus /sierra_2: Setting Powered False 06:47:18.449961 run create_hlr_db(pid=19294): Terminated: ok {rc=0} 06:47:18.886018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19296): Launched 06:47:19.223557 run osmo-hlr_10.42.42.2(pid=19297): Launched 06:47:19.353792 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:19.907268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19299): Launched 06:47:20.242899 run osmo-stp_10.42.42.5(pid=19300): Launched 06:47:20.370830 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:20.948433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19302): Launched 06:47:21.285599 run osmo-msc_10.42.42.6(pid=19303): Launched 06:47:21.472701 run osmo-stp_10.42.42.5(pid=19300): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19300)] 06:47:21.613491 run osmo-stp_10.42.42.5(pid=19300): stdout: | (launched: 2022-12-14_06:47:20.180896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:21.754910 run osmo-stp_10.42.42.5(pid=19300): stderr: | 20221214064720377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064720377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064720377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064720378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064720378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064720378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064720378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:21.894374 run osmo-stp_10.42.42.5(pid=19300): stdout: | (launched: 2022-12-14_06:47:20.180896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:22.027666 run osmo-stp_10.42.42.5(pid=19300): stderr: | 20221214064720377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064720377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064720377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064720378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064720378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064720378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064720378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:22.187556 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19300): Process ended prematurely: osmo-stp_10.42.42.5(pid=19300) [trial-2400↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19300)] [trial-2400↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 06:47:22.196535 tst handover.py:18: Test FAILED (6.9 sec) 06:47:22.223906 run osmo-hlr_10.42.42.2(pid=19297): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19297)] 06:47:22.274222 run osmo-hlr_10.42.42.2(pid=19297): stdout: | (launched: 2022-12-14_06:47:19.162109) 06:47:22.325852 run osmo-hlr_10.42.42.2(pid=19297): stderr: | 20221214064719361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064719361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064719361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064719361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064719361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064719361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064719372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064719381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064719381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064719381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:22.398259 run osmo-msc_10.42.42.6(pid=19303): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19303)] 06:47:22.447722 run osmo-msc_10.42.42.6(pid=19303): stdout: | (launched: 2022-12-14_06:47:21.223508) 06:47:22.499241 run osmo-msc_10.42.42.6(pid=19303): stderr: | 20221214064721548 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064721548 DLGLOBAL DEBUG validating counter group 0x7f509c57dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064721548 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064721548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064721549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064721549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064721550 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064721551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064721551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064721551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:22.550964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19296): Terminating (SIGTERM) 06:47:22.592730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19299): Terminating (SIGTERM) 06:47:22.635101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19302): Terminating (SIGTERM) 06:47:22.677931 --- ParallelTerminationStrategy: PID 19296 died... 06:47:22.698411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19296): Terminated: ok {rc=0} 06:47:22.745226 --- ParallelTerminationStrategy: PID 19299 died... 06:47:22.765146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19299): Terminated: ok {rc=0} 06:47:22.811663 --- ParallelTerminationStrategy: PID 19302 died... 06:47:22.831767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19302): Terminated: ok {rc=0} 06:47:22.919847 bus /sierra_3: Setting Powered False 06:47:24.019025 bus /sierra_3: Setting Powered False 06:47:25.134476 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 06:47:26.385490 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:26.391064 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:47:26.446628 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:47:26.473936 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:47:26.524582 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:47:26.579905 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:47:26.607216 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:47:27.161199 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 06:47:27.166933 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:27.178506 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:47:27.217215 tst handover.py: using LAC 39128 06:47:27.348157 tst handover.py: using RAC 113 06:47:27.478810 tst handover.py: using CellId 39128 06:47:27.609783 tst handover.py: using BVCI 39129 06:47:27.735615 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:47:27.782576 tst handover.py: using LAC 39129 06:47:27.913267 tst handover.py: using RAC 114 06:47:28.044084 tst handover.py: using CellId 39129 06:47:28.177163 tst handover.py: using BVCI 39130 06:47:28.300527 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:28.312095 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:28.323478 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:28.335003 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:28.347025 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:28.358778 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:47:28.476448 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:47:28.597891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:29.089752 run create_hlr_db(pid=19308): Launched 06:47:29.219476 bus /sierra_2: Setting Powered False 06:47:30.284932 run create_hlr_db(pid=19308): Terminated: ok {rc=0} 06:47:30.722249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19310): Launched 06:47:31.069137 run osmo-hlr_10.42.42.2(pid=19311): Launched 06:47:31.269227 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:31.886915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19313): Launched 06:47:32.233712 run osmo-stp_10.42.42.5(pid=19314): Launched 06:47:32.410681 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:33.070035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19316): Launched 06:47:33.408550 run osmo-msc_10.42.42.6(pid=19317): Launched 06:47:33.596125 run osmo-stp_10.42.42.5(pid=19314): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19314)] 06:47:33.737468 run osmo-stp_10.42.42.5(pid=19314): stdout: | (launched: 2022-12-14_06:47:32.165981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:33.879264 run osmo-stp_10.42.42.5(pid=19314): stderr: | 20221214064732437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064732437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064732437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064732438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064732438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064732438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064732438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:34.018992 run osmo-stp_10.42.42.5(pid=19314): stdout: | (launched: 2022-12-14_06:47:32.165981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:34.152798 run osmo-stp_10.42.42.5(pid=19314): stderr: | 20221214064732437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064732437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064732437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064732438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064732438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064732438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064732438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:34.313132 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19314): Process ended prematurely: osmo-stp_10.42.42.5(pid=19314) [trial-2400↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19314)] [trial-2400↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 06:47:34.322211 tst handover.py:18: Test FAILED (7.1 sec) 06:47:34.349859 run osmo-hlr_10.42.42.2(pid=19311): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19311)] 06:47:34.400766 run osmo-hlr_10.42.42.2(pid=19311): stdout: | (launched: 2022-12-14_06:47:31.009179) 06:47:34.453357 run osmo-hlr_10.42.42.2(pid=19311): stderr: | 20221214064731416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064731416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064731416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064731416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064731416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064731416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064731431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064731439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064731439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064731439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:34.526330 run osmo-msc_10.42.42.6(pid=19317): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19317)] 06:47:34.576464 run osmo-msc_10.42.42.6(pid=19317): stdout: | (launched: 2022-12-14_06:47:33.346695) 06:47:34.629120 run osmo-msc_10.42.42.6(pid=19317): stderr: | 20221214064733670 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064733670 DLGLOBAL DEBUG validating counter group 0x7fb2d4958c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064733671 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064733671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064733671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064733671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064733673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064733673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064733673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064733673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:34.681779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19310): Terminating (SIGTERM) 06:47:34.723806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19313): Terminating (SIGTERM) 06:47:34.766618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19316): Terminating (SIGTERM) 06:47:34.809081 --- ParallelTerminationStrategy: PID 19310 died... 06:47:34.829607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19310): Terminated: ok {rc=0} 06:47:34.876391 --- ParallelTerminationStrategy: PID 19313 died... 06:47:34.896479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19313): Terminated: ok {rc=0} 06:47:34.943001 --- ParallelTerminationStrategy: PID 19316 died... 06:47:34.963142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19316): Terminated: ok {rc=0} 06:47:35.051537 bus /sierra_3: Setting Powered False 06:47:36.151000 bus /sierra_3: Setting Powered False 06:47:37.267521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:47:38.529617 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:38.535360 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:47:38.587037 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:47:38.614082 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:47:38.667258 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:47:38.719316 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:47:38.746863 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:47:39.299316 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:47:39.305264 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:39.317015 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:47:39.357783 tst handover.py: using LAC 39130 06:47:39.483259 tst handover.py: using RAC 115 06:47:39.606741 tst handover.py: using CellId 39130 06:47:39.732942 tst handover.py: using BVCI 39131 06:47:39.848466 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:47:39.893430 tst handover.py: using LAC 39131 06:47:40.018893 tst handover.py: using RAC 116 06:47:40.144541 tst handover.py: using CellId 39131 06:47:40.269353 tst handover.py: using BVCI 39132 06:47:40.385094 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:40.396253 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:40.407229 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:40.418314 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:40.429340 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:40.440312 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:47:40.560389 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:47:40.682425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:41.175456 run create_hlr_db(pid=19322): Launched 06:47:41.305764 bus /sierra_2: Setting Powered False 06:47:42.371613 run create_hlr_db(pid=19322): Terminated: ok {rc=0} 06:47:42.794081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19324): Launched 06:47:43.109727 run osmo-hlr_10.42.42.2(pid=19325): Launched 06:47:43.230279 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:43.760522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19327): Launched 06:47:44.075472 run osmo-stp_10.42.42.5(pid=19328): Launched 06:47:44.196234 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:44.743140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19330): Launched 06:47:45.060535 run osmo-msc_10.42.42.6(pid=19331): Launched 06:47:45.237796 run osmo-stp_10.42.42.5(pid=19328): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19328)] 06:47:45.371100 run osmo-stp_10.42.42.5(pid=19328): stdout: | (launched: 2022-12-14_06:47:44.016804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:45.503207 run osmo-stp_10.42.42.5(pid=19328): stderr: | 20221214064744189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064744189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064744189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064744190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064744190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064744190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064744190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:45.633997 run osmo-stp_10.42.42.5(pid=19328): stdout: | (launched: 2022-12-14_06:47:44.016804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:45.759075 run osmo-stp_10.42.42.5(pid=19328): stderr: | 20221214064744189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064744189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064744189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064744190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064744190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064744190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064744190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:45.954447 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19328): Process ended prematurely: osmo-stp_10.42.42.5(pid=19328) [trial-2400↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19328)] [trial-2400↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 06:47:45.964809 tst handover.py:18: Test FAILED (6.7 sec) 06:47:45.993961 run osmo-hlr_10.42.42.2(pid=19325): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19325)] 06:47:46.051652 run osmo-hlr_10.42.42.2(pid=19325): stdout: | (launched: 2022-12-14_06:47:43.051447) 06:47:46.106615 run osmo-hlr_10.42.42.2(pid=19325): stderr: | 20221214064743232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064743232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064743232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064743232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064743232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064743232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064743245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064743253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064743253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064743253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:46.183276 run osmo-msc_10.42.42.6(pid=19331): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19331)] 06:47:46.237823 run osmo-msc_10.42.42.6(pid=19331): stdout: | (launched: 2022-12-14_06:47:45.002024) 06:47:46.292920 run osmo-msc_10.42.42.6(pid=19331): stderr: | 20221214064745276 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064745276 DLGLOBAL DEBUG validating counter group 0x7f03ff344c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064745276 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064745276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064745276 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064745277 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064745278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064745279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064745279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064745279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:46.348205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19324): Terminating (SIGTERM) 06:47:46.392143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19327): Terminating (SIGTERM) 06:47:46.439806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19330): Terminating (SIGTERM) 06:47:46.487081 --- ParallelTerminationStrategy: PID 19324 died... 06:47:46.509357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19324): Terminated: ok {rc=0} 06:47:46.560405 --- ParallelTerminationStrategy: PID 19327 died... 06:47:46.583064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19327): Terminated: ok {rc=0} 06:47:46.632515 --- ParallelTerminationStrategy: PID 19330 died... 06:47:46.653918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19330): Terminated: ok {rc=0} 06:47:46.747571 bus /sierra_3: Setting Powered False 06:47:47.848593 bus /sierra_3: Setting Powered False 06:47:48.963782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:47:50.218011 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:50.223131 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:47:50.276594 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:47:50.303176 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:47:50.354513 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:47:50.408435 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:47:50.434729 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:47:50.986964 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:47:50.992395 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:51.003594 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:47:51.040775 tst handover.py: using LAC 39132 06:47:51.164256 tst handover.py: using RAC 117 06:47:51.289496 tst handover.py: using CellId 39132 06:47:51.414513 tst handover.py: using BVCI 39133 06:47:51.530339 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:47:51.579705 tst handover.py: using LAC 39133 06:47:51.704694 tst handover.py: using RAC 118 06:47:51.829714 tst handover.py: using CellId 39133 06:47:51.954709 tst handover.py: using BVCI 39134 06:47:52.071021 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:52.082215 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:52.093120 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:52.103971 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:52.114895 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:52.125782 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:47:52.242949 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:47:52.365040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:52.855638 run create_hlr_db(pid=19338): Launched 06:47:52.985323 bus /sierra_2: Setting Powered False 06:47:54.051499 run create_hlr_db(pid=19338): Terminated: ok {rc=0} 06:47:54.473221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19340): Launched 06:47:54.788652 run osmo-hlr_10.42.42.2(pid=19341): Launched 06:47:54.908794 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:55.423240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19343): Launched 06:47:55.737445 run osmo-stp_10.42.42.5(pid=19344): Launched 06:47:55.857226 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:56.397786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19346): Launched 06:47:56.711141 run osmo-msc_10.42.42.6(pid=19347): Launched 06:47:56.886712 run osmo-stp_10.42.42.5(pid=19344): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19344)] 06:47:57.020323 run osmo-stp_10.42.42.5(pid=19344): stdout: | (launched: 2022-12-14_06:47:55.679484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:57.151246 run osmo-stp_10.42.42.5(pid=19344): stderr: | 20221214064755853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064755853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064755853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064755854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064755854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064755854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064755854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:57.281208 run osmo-stp_10.42.42.5(pid=19344): stdout: | (launched: 2022-12-14_06:47:55.679484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:57.405212 run osmo-stp_10.42.42.5(pid=19344): stderr: | 20221214064755853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064755853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064755853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064755854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064755854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064755854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064755854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:57.554096 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19344): Process ended prematurely: osmo-stp_10.42.42.5(pid=19344) [trial-2400↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19344)] [trial-2400↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 06:47:57.562705 tst handover.py:18: Test FAILED (6.6 sec) 06:47:57.588799 run osmo-hlr_10.42.42.2(pid=19341): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19341)] 06:47:57.635878 run osmo-hlr_10.42.42.2(pid=19341): stdout: | (launched: 2022-12-14_06:47:54.730732) 06:47:57.685087 run osmo-hlr_10.42.42.2(pid=19341): stderr: | 20221214064754909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064754909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064754909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064754909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064754909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064754909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064754921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064754929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064754929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064754930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:57.753374 run osmo-msc_10.42.42.6(pid=19347): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19347)] 06:47:57.800295 run osmo-msc_10.42.42.6(pid=19347): stdout: | (launched: 2022-12-14_06:47:56.653144) 06:47:57.849176 run osmo-msc_10.42.42.6(pid=19347): stderr: | 20221214064756924 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064756924 DLGLOBAL DEBUG validating counter group 0x7fda5d94ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064756924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064756925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064756925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064756925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064756927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064756927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064756927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064756927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:57.898302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19340): Terminating (SIGTERM) 06:47:57.938335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19343): Terminating (SIGTERM) 06:47:57.978205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19346): Terminating (SIGTERM) 06:47:58.017838 --- ParallelTerminationStrategy: PID 19340 died... 06:47:58.036868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19340): Terminated: ok {rc=0} 06:47:58.080551 --- ParallelTerminationStrategy: PID 19343 died... 06:47:58.099240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19343): Terminated: ok {rc=0} 06:47:58.142607 --- ParallelTerminationStrategy: PID 19346 died... 06:47:58.161182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19346): Terminated: ok {rc=0} 06:47:58.245712 bus /sierra_3: Setting Powered False 06:47:59.343645 bus /sierra_3: Setting Powered False 06:48:00.454825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 06:48:01.753899 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:01.762406 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:48:01.814345 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:48:01.848397 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:48:01.907589 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:48:01.950023 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:48:01.977615 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:48:02.526703 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 06:48:02.532846 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:02.544475 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 06:48:02.582320 tst handover.py: using LAC 39134 06:48:02.708141 tst handover.py: using RAC 119 06:48:02.833003 tst handover.py: using CellId 39134 06:48:02.956798 tst handover.py: using BVCI 39135 06:48:03.072166 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 06:48:03.106959 tst handover.py: using LAC 39135 06:48:03.230586 tst handover.py: using RAC 120 06:48:03.355663 tst handover.py: using CellId 39135 06:48:03.484481 tst handover.py: using BVCI 39136 06:48:03.599387 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:03.610299 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:03.620937 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:03.631644 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:03.642359 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:03.653071 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 06:48:03.774162 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 06:48:03.896606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:04.387746 run create_hlr_db(pid=19352): Launched 06:48:04.515421 bus /sierra_2: Setting Powered False 06:48:05.578472 run create_hlr_db(pid=19352): Terminated: ok {rc=0} 06:48:05.987802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19354): Launched 06:48:06.302357 run osmo-hlr_10.42.42.2(pid=19355): Launched 06:48:06.424296 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:06.936754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19357): Launched 06:48:07.250191 run osmo-stp_10.42.42.5(pid=19358): Launched 06:48:07.370292 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:07.908934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19360): Launched 06:48:08.224120 run osmo-msc_10.42.42.6(pid=19361): Launched 06:48:08.400157 run osmo-stp_10.42.42.5(pid=19358): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19358)] 06:48:08.532591 run osmo-stp_10.42.42.5(pid=19358): stdout: | (launched: 2022-12-14_06:48:07.191702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:08.664699 run osmo-stp_10.42.42.5(pid=19358): stderr: | 20221214064807362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064807362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064807363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064807363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064807366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064807366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064807366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:08.794413 run osmo-stp_10.42.42.5(pid=19358): stdout: | (launched: 2022-12-14_06:48:07.191702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:08.919012 run osmo-stp_10.42.42.5(pid=19358): stderr: | 20221214064807362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064807362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064807363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064807363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064807366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064807366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064807366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:09.067992 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19358): Process ended prematurely: osmo-stp_10.42.42.5(pid=19358) [trial-2400↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19358)] [trial-2400↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 06:48:09.076480 tst handover.py:18: Test FAILED (6.5 sec) 06:48:09.102578 run osmo-hlr_10.42.42.2(pid=19355): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19355)] 06:48:09.149846 run osmo-hlr_10.42.42.2(pid=19355): stdout: | (launched: 2022-12-14_06:48:06.244326) 06:48:09.198934 run osmo-hlr_10.42.42.2(pid=19355): stderr: | 20221214064806423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064806423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064806423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064806423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064806423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064806423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064806435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064806443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064806444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064806444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:09.267221 run osmo-msc_10.42.42.6(pid=19361): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19361)] 06:48:09.314333 run osmo-msc_10.42.42.6(pid=19361): stdout: | (launched: 2022-12-14_06:48:08.165872) 06:48:09.363214 run osmo-msc_10.42.42.6(pid=19361): stderr: | 20221214064808439 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064808439 DLGLOBAL DEBUG validating counter group 0x7f1235062c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064808439 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064808439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064808439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064808439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064808441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064808442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064808442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064808442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:09.412326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19354): Terminating (SIGTERM) 06:48:09.451187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19357): Terminating (SIGTERM) 06:48:09.490219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19360): Terminating (SIGTERM) 06:48:09.529654 --- ParallelTerminationStrategy: PID 19354 died... 06:48:09.548593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19354): Terminated: ok {rc=0} 06:48:09.592423 --- ParallelTerminationStrategy: PID 19357 died... 06:48:09.611047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19357): Terminated: ok {rc=0} 06:48:09.654453 --- ParallelTerminationStrategy: PID 19360 died... 06:48:09.673028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19360): Terminated: ok {rc=0} 06:48:09.756293 bus /sierra_3: Setting Powered False 06:48:10.854431 bus /sierra_3: Setting Powered False 06:48:11.971470 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 06:48:13.217581 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:13.222706 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:48:13.275966 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:48:13.302346 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:48:13.352130 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:48:13.405178 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:48:13.431224 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:48:13.983527 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 06:48:13.989036 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:14.000174 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:48:14.037615 tst handover.py: using LAC 39136 06:48:14.160182 tst handover.py: using RAC 121 06:48:14.291312 tst handover.py: using CellId 39136 06:48:14.421197 tst handover.py: using BVCI 39137 06:48:14.543412 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:48:14.592177 tst handover.py: using LAC 39137 06:48:14.721920 tst handover.py: using RAC 122 06:48:14.851626 tst handover.py: using CellId 39137 06:48:14.981330 tst handover.py: using BVCI 39138 06:48:15.105242 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:15.116597 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:15.127945 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:15.139104 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:15.150695 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:15.162603 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:48:15.280243 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:48:15.401931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:15.899325 run create_hlr_db(pid=19366): Launched 06:48:16.064792 bus /sierra_2: Setting Powered False 06:48:17.141409 run create_hlr_db(pid=19366): Terminated: ok {rc=0} 06:48:17.586818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19368): Launched 06:48:17.925565 run osmo-hlr_10.42.42.2(pid=19369): Launched 06:48:18.054973 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:18.608058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19371): Launched 06:48:18.943824 run osmo-stp_10.42.42.5(pid=19372): Launched 06:48:19.074578 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:19.654454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19374): Launched 06:48:19.973061 run osmo-msc_10.42.42.6(pid=19375): Launched 06:48:20.151521 run osmo-stp_10.42.42.5(pid=19372): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19372)] 06:48:20.283457 run osmo-stp_10.42.42.5(pid=19372): stdout: | (launched: 2022-12-14_06:48:18.882360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:20.415582 run osmo-stp_10.42.42.5(pid=19372): stderr: | 20221214064819077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064819077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064819077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064819078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064819078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064819078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064819078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:20.545920 run osmo-stp_10.42.42.5(pid=19372): stdout: | (launched: 2022-12-14_06:48:18.882360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:20.670730 run osmo-stp_10.42.42.5(pid=19372): stderr: | 20221214064819077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064819077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064819077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064819078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064819078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064819078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064819078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:20.819837 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19372): Process ended prematurely: osmo-stp_10.42.42.5(pid=19372) [trial-2400↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19372)] [trial-2400↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 06:48:20.828396 tst handover.py:18: Test FAILED (6.8 sec) 06:48:20.854498 run osmo-hlr_10.42.42.2(pid=19369): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19369)] 06:48:20.902362 run osmo-hlr_10.42.42.2(pid=19369): stdout: | (launched: 2022-12-14_06:48:17.863861) 06:48:20.951560 run osmo-hlr_10.42.42.2(pid=19369): stderr: | 20221214064818063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064818064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064818064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064818064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064818064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064818064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064818076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064818084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064818084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064818084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:21.020091 run osmo-msc_10.42.42.6(pid=19375): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19375)] 06:48:21.067252 run osmo-msc_10.42.42.6(pid=19375): stdout: | (launched: 2022-12-14_06:48:19.915274) 06:48:21.117077 run osmo-msc_10.42.42.6(pid=19375): stderr: | 20221214064820187 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064820188 DLGLOBAL DEBUG validating counter group 0x7fa2f45afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064820188 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064820188 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064820188 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064820188 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064820190 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064820190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064820190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064820190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:21.166449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19368): Terminating (SIGTERM) 06:48:21.206118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19371): Terminating (SIGTERM) 06:48:21.245820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19374): Terminating (SIGTERM) 06:48:21.285862 --- ParallelTerminationStrategy: PID 19368 died... 06:48:21.305137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19368): Terminated: ok {rc=0} 06:48:21.349547 --- ParallelTerminationStrategy: PID 19371 died... 06:48:21.368135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19371): Terminated: ok {rc=0} 06:48:21.412084 --- ParallelTerminationStrategy: PID 19374 died... 06:48:21.430980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19374): Terminated: ok {rc=0} 06:48:21.514195 bus /sierra_3: Setting Powered False 06:48:22.613899 bus /sierra_3: Setting Powered False 06:48:23.727553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 06:48:24.990161 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:24.996017 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:48:25.051383 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:48:25.078642 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:48:25.132096 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:48:25.185427 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:48:25.211838 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:48:25.765793 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 06:48:25.772164 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:25.784074 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:48:25.823020 tst handover.py: using LAC 39138 06:48:25.954512 tst handover.py: using RAC 123 06:48:26.087942 tst handover.py: using CellId 39138 06:48:26.219776 tst handover.py: using BVCI 39139 06:48:26.342512 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:48:26.391543 tst handover.py: using LAC 39139 06:48:26.525835 tst handover.py: using RAC 124 06:48:26.651425 tst handover.py: using CellId 39139 06:48:26.778278 tst handover.py: using BVCI 39140 06:48:26.902663 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:26.914309 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:26.925686 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:26.936918 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:26.949291 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:26.961113 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:48:27.080272 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:48:27.203198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:27.698227 run create_hlr_db(pid=19380): Launched 06:48:27.828420 bus /sierra_2: Setting Powered False 06:48:28.895149 run create_hlr_db(pid=19380): Terminated: ok {rc=0} 06:48:29.318156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19382): Launched 06:48:29.634433 run osmo-hlr_10.42.42.2(pid=19383): Launched 06:48:29.755005 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:30.270289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19385): Launched 06:48:30.584328 run osmo-stp_10.42.42.5(pid=19386): Launched 06:48:30.704612 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:31.256921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19388): Launched 06:48:31.589300 run osmo-msc_10.42.42.6(pid=19389): Launched 06:48:31.980558 run osmo-stp_10.42.42.5(pid=19386): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19386)] 06:48:32.296174 run osmo-stp_10.42.42.5(pid=19386): stdout: | (launched: 2022-12-14_06:48:30.525820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:32.480499 run osmo-stp_10.42.42.5(pid=19386): stderr: | 20221214064830700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064830700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064830700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064830701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064830701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064830701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064830701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:32.620623 run osmo-stp_10.42.42.5(pid=19386): stdout: | (launched: 2022-12-14_06:48:30.525820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:32.754731 run osmo-stp_10.42.42.5(pid=19386): stderr: | 20221214064830700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064830700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064830700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064830701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064830701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064830701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064830701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:32.914797 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19386): Process ended prematurely: osmo-stp_10.42.42.5(pid=19386) [trial-2400↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19386)] [trial-2400↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 06:48:32.924145 tst handover.py:18: Test FAILED (7.1 sec) 06:48:32.951933 run osmo-hlr_10.42.42.2(pid=19383): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19383)] 06:48:33.003895 run osmo-hlr_10.42.42.2(pid=19383): stdout: | (launched: 2022-12-14_06:48:29.576513) 06:48:33.056905 run osmo-hlr_10.42.42.2(pid=19383): stderr: | 20221214064829753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064829753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064829753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064829753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064829753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064829753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064829766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064829774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064829774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064829774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:33.130290 run osmo-msc_10.42.42.6(pid=19389): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19389)] 06:48:33.181086 run osmo-msc_10.42.42.6(pid=19389): stdout: | (launched: 2022-12-14_06:48:31.530201) 06:48:33.234002 run osmo-msc_10.42.42.6(pid=19389): stderr: | 20221214064832099 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064832099 DLGLOBAL DEBUG validating counter group 0x7f71572cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064832099 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064832099 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064832100 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064832100 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064832101 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064832102 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064832102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064832102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:33.287089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19382): Terminating (SIGTERM) 06:48:33.329183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19385): Terminating (SIGTERM) 06:48:33.371995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19388): Terminating (SIGTERM) 06:48:33.415601 --- ParallelTerminationStrategy: PID 19382 died... 06:48:33.436466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19382): Terminated: ok {rc=0} 06:48:33.483673 --- ParallelTerminationStrategy: PID 19385 died... 06:48:33.504043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19385): Terminated: ok {rc=0} 06:48:33.551097 --- ParallelTerminationStrategy: PID 19388 died... 06:48:33.571472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19388): Terminated: ok {rc=0} 06:48:33.659784 bus /sierra_3: Setting Powered False 06:48:34.759311 bus /sierra_3: Setting Powered False 06:48:35.875827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 06:48:37.137341 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:37.142542 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 06:48:37.178790 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 06:48:37.205989 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 06:48:37.255936 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 06:48:37.292107 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 06:48:37.318593 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 06:48:37.869686 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 06:48:37.875374 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:48:37.886509 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 06:48:37.920326 tst handover.py: using LAC 39140 06:48:38.049314 tst handover.py: using RAC 125 06:48:38.173228 tst handover.py: using CellId 39140 06:48:38.302159 tst handover.py: using BVCI 39141 06:48:38.418924 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 06:48:38.451944 tst handover.py: using LAC 39141 06:48:38.576317 tst handover.py: using RAC 126 06:48:38.708231 tst handover.py: using CellId 39141 06:48:38.838211 tst handover.py: using BVCI 39142 06:48:38.961356 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:48:38.972620 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:48:38.983850 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:48:38.995005 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:48:39.006935 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:48:39.019010 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 06:48:39.139520 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 06:48:39.259185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:39.723071 run create_hlr_db(pid=19394): Launched 06:48:39.852858 bus /sierra_2: Setting Powered False 06:48:40.915717 run create_hlr_db(pid=19394): Terminated: ok {rc=0} 06:48:41.346820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19396): Launched 06:48:41.684425 run osmo-hlr_10.42.42.2(pid=19397): Launched 06:48:41.814173 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:42.366583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19399): Launched 06:48:42.703553 run osmo-stp_10.42.42.5(pid=19400): Launched 06:48:42.834161 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:43.417122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19402): Launched 06:48:43.754250 run osmo-msc_10.42.42.6(pid=19403): Launched 06:48:43.943404 run osmo-stp_10.42.42.5(pid=19400): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19400)] 06:48:44.085410 run osmo-stp_10.42.42.5(pid=19400): stdout: | (launched: 2022-12-14_06:48:42.641078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:44.228179 run osmo-stp_10.42.42.5(pid=19400): stderr: | 20221214064842838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064842838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064842839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064842839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064842839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064842839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064842840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:44.368541 run osmo-stp_10.42.42.5(pid=19400): stdout: | (launched: 2022-12-14_06:48:42.641078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:44.502291 run osmo-stp_10.42.42.5(pid=19400): stderr: | 20221214064842838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064842838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064842839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064842839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064842839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064842839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064842840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:44.662113 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19400): Process ended prematurely: osmo-stp_10.42.42.5(pid=19400) [trial-2400↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19400)] [trial-2400↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 06:48:44.671102 tst handover.py:18: Test FAILED (6.8 sec) 06:48:44.698455 run osmo-hlr_10.42.42.2(pid=19397): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19397)] 06:48:44.749084 run osmo-hlr_10.42.42.2(pid=19397): stdout: | (launched: 2022-12-14_06:48:41.622869) 06:48:44.801216 run osmo-hlr_10.42.42.2(pid=19397): stderr: | 20221214064841824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064841824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064841824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064841824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064841824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064841824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064841858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064841867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064841867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064841867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:44.873536 run osmo-msc_10.42.42.6(pid=19403): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19403)] 06:48:44.923410 run osmo-msc_10.42.42.6(pid=19403): stdout: | (launched: 2022-12-14_06:48:43.692368) 06:48:44.975190 run osmo-msc_10.42.42.6(pid=19403): stderr: | 20221214064844016 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064844017 DLGLOBAL DEBUG validating counter group 0x7f2bf0f31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064844017 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064844017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064844017 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064844017 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064844019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064844019 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064844019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064844019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:45.027540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19396): Terminating (SIGTERM) 06:48:45.069436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19399): Terminating (SIGTERM) 06:48:45.111337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19402): Terminating (SIGTERM) 06:48:45.153819 --- ParallelTerminationStrategy: PID 19396 died... 06:48:45.174382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19396): Terminated: ok {rc=0} 06:48:45.220674 --- ParallelTerminationStrategy: PID 19399 died... 06:48:45.240682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19399): Terminated: ok {rc=0} 06:48:45.286603 --- ParallelTerminationStrategy: PID 19402 died... 06:48:45.306407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19402): Terminated: ok {rc=0} 06:48:45.394404 bus /sierra_3: Setting Powered False 06:48:46.489866 bus /sierra_3: Setting Powered False 06:48:47.605854 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 06:48:48.847759 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:48.853503 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:48:48.905525 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:48:48.932636 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:48:48.987404 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:48:49.040809 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:48:49.068108 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:48:49.611698 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 06:48:49.617994 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:49.629514 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:48:49.668333 tst handover.py: using LAC 39142 06:48:49.792923 tst handover.py: using RAC 127 06:48:49.915464 tst handover.py: using CellId 39142 06:48:50.039085 tst handover.py: using BVCI 39143 06:48:50.153702 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:48:50.200474 tst handover.py: using LAC 39143 06:48:50.331769 tst handover.py: using RAC 128 06:48:50.467198 tst handover.py: using CellId 39143 06:48:50.598216 tst handover.py: using BVCI 39144 06:48:50.721212 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:50.732777 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:50.744101 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:50.755466 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:50.767386 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:50.779222 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:48:50.896874 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:48:51.019031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:51.511876 run create_hlr_db(pid=19408): Launched 06:48:51.641613 bus /sierra_2: Setting Powered False 06:48:52.707647 run create_hlr_db(pid=19408): Terminated: ok {rc=0} 06:48:53.129089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19410): Launched 06:48:53.444868 run osmo-hlr_10.42.42.2(pid=19411): Launched 06:48:53.565563 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:54.081280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19413): Launched 06:48:54.396700 run osmo-stp_10.42.42.5(pid=19414): Launched 06:48:54.517509 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:55.059742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19416): Launched 06:48:55.374565 run osmo-msc_10.42.42.6(pid=19417): Launched 06:48:55.550510 run osmo-stp_10.42.42.5(pid=19414): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19414)] 06:48:55.682914 run osmo-stp_10.42.42.5(pid=19414): stdout: | (launched: 2022-12-14_06:48:54.337359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:55.814074 run osmo-stp_10.42.42.5(pid=19414): stderr: | 20221214064854511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064854511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064854511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064854512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064854512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064854512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064854512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:55.943688 run osmo-stp_10.42.42.5(pid=19414): stdout: | (launched: 2022-12-14_06:48:54.337359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:56.067587 run osmo-stp_10.42.42.5(pid=19414): stderr: | 20221214064854511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064854511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064854511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064854512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064854512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064854512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064854512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:56.216254 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19414): Process ended prematurely: osmo-stp_10.42.42.5(pid=19414) [trial-2400↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19414)] [trial-2400↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 06:48:56.224627 tst handover.py:18: Test FAILED (6.6 sec) 06:48:56.250433 run osmo-hlr_10.42.42.2(pid=19411): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19411)] 06:48:56.298214 run osmo-hlr_10.42.42.2(pid=19411): stdout: | (launched: 2022-12-14_06:48:53.386415) 06:48:56.346938 run osmo-hlr_10.42.42.2(pid=19411): stderr: | 20221214064853563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064853563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064853563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064853563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064853563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064853564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064853576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064853586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064853586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064853586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:56.415783 run osmo-msc_10.42.42.6(pid=19417): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19417)] 06:48:56.462738 run osmo-msc_10.42.42.6(pid=19417): stdout: | (launched: 2022-12-14_06:48:55.316309) 06:48:56.511323 run osmo-msc_10.42.42.6(pid=19417): stderr: | 20221214064855588 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064855589 DLGLOBAL DEBUG validating counter group 0x7f9fa6e30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064855589 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064855589 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064855589 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064855589 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064855591 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064855591 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064855591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064855591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:56.561039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19410): Terminating (SIGTERM) 06:48:56.600203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19413): Terminating (SIGTERM) 06:48:56.639034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19416): Terminating (SIGTERM) 06:48:56.678150 --- ParallelTerminationStrategy: PID 19410 died... 06:48:56.697065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19410): Terminated: ok {rc=0} 06:48:56.740342 --- ParallelTerminationStrategy: PID 19413 died... 06:48:56.759075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19413): Terminated: ok {rc=0} 06:48:56.802092 --- ParallelTerminationStrategy: PID 19416 died... 06:48:56.820264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19416): Terminated: ok {rc=0} 06:48:56.902929 bus /sierra_3: Setting Powered False 06:48:57.999358 bus /sierra_3: Setting Powered False 06:48:59.115765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:49:00.370161 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:00.376433 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:49:00.424680 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:49:00.451965 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:49:00.505962 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:49:00.554877 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:49:00.582090 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:49:01.129095 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:49:01.135834 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:01.148017 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:49:01.182869 tst handover.py: using LAC 39144 06:49:01.320485 tst handover.py: using RAC 129 06:49:01.454872 tst handover.py: using CellId 39144 06:49:01.593528 tst handover.py: using BVCI 39145 06:49:01.721481 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:49:01.766878 tst handover.py: using LAC 39145 06:49:01.902222 tst handover.py: using RAC 130 06:49:02.036092 tst handover.py: using CellId 39145 06:49:02.168184 tst handover.py: using BVCI 39146 06:49:02.293055 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:02.304583 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:02.315997 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:02.327422 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:02.339182 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:02.350863 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:49:02.469339 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:49:02.590154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:03.081964 run create_hlr_db(pid=19422): Launched 06:49:03.210793 bus /sierra_2: Setting Powered False 06:49:04.276441 run create_hlr_db(pid=19422): Terminated: ok {rc=0} 06:49:04.699580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19424): Launched 06:49:05.017262 run osmo-hlr_10.42.42.2(pid=19425): Launched 06:49:05.137793 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:05.653208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19427): Launched 06:49:05.967210 run osmo-stp_10.42.42.5(pid=19428): Launched 06:49:06.089875 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:06.633589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19430): Launched 06:49:06.948550 run osmo-msc_10.42.42.6(pid=19431): Launched 06:49:07.124350 run osmo-stp_10.42.42.5(pid=19428): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19428)] 06:49:07.256728 run osmo-stp_10.42.42.5(pid=19428): stdout: | (launched: 2022-12-14_06:49:05.909228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:07.388603 run osmo-stp_10.42.42.5(pid=19428): stderr: | 20221214064906083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064906083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064906084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064906084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064906085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064906085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064906085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:07.519158 run osmo-stp_10.42.42.5(pid=19428): stdout: | (launched: 2022-12-14_06:49:05.909228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:07.644275 run osmo-stp_10.42.42.5(pid=19428): stderr: | 20221214064906083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064906083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064906084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064906084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064906085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064906085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064906085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:07.793693 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19428): Process ended prematurely: osmo-stp_10.42.42.5(pid=19428) [trial-2400↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19428)] [trial-2400↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 06:49:07.802008 tst handover.py:18: Test FAILED (6.7 sec) 06:49:07.828380 run osmo-hlr_10.42.42.2(pid=19425): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19425)] 06:49:07.876634 run osmo-hlr_10.42.42.2(pid=19425): stdout: | (launched: 2022-12-14_06:49:04.958507) 06:49:07.925767 run osmo-hlr_10.42.42.2(pid=19425): stderr: | 20221214064905137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064905137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064905137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064905137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064905137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064905137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064905172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064905182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064905182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064905182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:07.994268 run osmo-msc_10.42.42.6(pid=19431): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19431)] 06:49:08.041551 run osmo-msc_10.42.42.6(pid=19431): stdout: | (launched: 2022-12-14_06:49:06.890405) 06:49:08.090620 run osmo-msc_10.42.42.6(pid=19431): stderr: | 20221214064907168 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064907168 DLGLOBAL DEBUG validating counter group 0x7f88af289c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064907168 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064907168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064907168 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064907169 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064907170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064907171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064907171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064907171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:08.140474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19424): Terminating (SIGTERM) 06:49:08.179957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19427): Terminating (SIGTERM) 06:49:08.219408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19430): Terminating (SIGTERM) 06:49:08.259095 --- ParallelTerminationStrategy: PID 19424 died... 06:49:08.278301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19424): Terminated: ok {rc=0} 06:49:08.321902 --- ParallelTerminationStrategy: PID 19427 died... 06:49:08.340281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19427): Terminated: ok {rc=0} 06:49:08.384112 --- ParallelTerminationStrategy: PID 19430 died... 06:49:08.402667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19430): Terminated: ok {rc=0} 06:49:08.487465 bus /sierra_3: Setting Powered False 06:49:09.585935 bus /sierra_3: Setting Powered False 06:49:10.700674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:49:11.959755 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:11.966144 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:49:12.017350 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:49:12.043665 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:49:12.093155 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:49:12.142874 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:49:12.168797 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:49:12.722971 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:49:12.728426 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:12.739650 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:49:12.773476 tst handover.py: using LAC 39146 06:49:12.907920 tst handover.py: using RAC 131 06:49:13.032162 tst handover.py: using CellId 39146 06:49:13.157055 tst handover.py: using BVCI 39147 06:49:13.271499 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:49:13.318626 tst handover.py: using LAC 39147 06:49:13.441851 tst handover.py: using RAC 132 06:49:13.566763 tst handover.py: using CellId 39147 06:49:13.690813 tst handover.py: using BVCI 39148 06:49:13.806060 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:13.816899 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:13.827629 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:13.838340 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:13.849437 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:13.860353 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:49:13.976279 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:49:14.099223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:14.591539 run create_hlr_db(pid=19436): Launched 06:49:14.719625 bus /sierra_2: Setting Powered False 06:49:15.785228 run create_hlr_db(pid=19436): Terminated: ok {rc=0} 06:49:16.249284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19438): Launched 06:49:16.609483 run osmo-hlr_10.42.42.2(pid=19439): Launched 06:49:16.814607 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:17.491566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19441): Launched 06:49:17.807734 run osmo-stp_10.42.42.5(pid=19442): Launched 06:49:17.927343 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:18.467697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19444): Launched 06:49:18.783242 run osmo-msc_10.42.42.6(pid=19445): Launched 06:49:18.961999 run osmo-stp_10.42.42.5(pid=19442): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19442)] 06:49:19.094143 run osmo-stp_10.42.42.5(pid=19442): stdout: | (launched: 2022-12-14_06:49:17.748454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:19.226367 run osmo-stp_10.42.42.5(pid=19442): stderr: | 20221214064917922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064917923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064917923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064917923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064917924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064917924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064917924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:19.356660 run osmo-stp_10.42.42.5(pid=19442): stdout: | (launched: 2022-12-14_06:49:17.748454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:19.481289 run osmo-stp_10.42.42.5(pid=19442): stderr: | 20221214064917922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064917923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064917923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064917923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064917924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064917924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064917924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:19.630713 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19442): Process ended prematurely: osmo-stp_10.42.42.5(pid=19442) [trial-2400↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19442)] [trial-2400↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 06:49:19.639209 tst handover.py:18: Test FAILED (6.9 sec) 06:49:19.665137 run osmo-hlr_10.42.42.2(pid=19439): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19439)] 06:49:19.712603 run osmo-hlr_10.42.42.2(pid=19439): stdout: | (launched: 2022-12-14_06:49:16.546501) 06:49:19.761750 run osmo-hlr_10.42.42.2(pid=19439): stderr: | 20221214064916881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064916881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064916881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064916881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064916881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064916881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064916894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064916907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064916907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064916907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:19.830080 run osmo-msc_10.42.42.6(pid=19445): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19445)] 06:49:19.877344 run osmo-msc_10.42.42.6(pid=19445): stdout: | (launched: 2022-12-14_06:49:18.725193) 06:49:19.926020 run osmo-msc_10.42.42.6(pid=19445): stderr: | 20221214064918999 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064918999 DLGLOBAL DEBUG validating counter group 0x7f3dd30cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064919000 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064919000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064919000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064919000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064919003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064919003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064919003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064919003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:19.975160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19438): Terminating (SIGTERM) 06:49:20.014705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19441): Terminating (SIGTERM) 06:49:20.054139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19444): Terminating (SIGTERM) 06:49:20.094197 --- ParallelTerminationStrategy: PID 19438 died... 06:49:20.113750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19438): Terminated: ok {rc=0} 06:49:20.157992 --- ParallelTerminationStrategy: PID 19441 died... 06:49:20.176890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19441): Terminated: ok {rc=0} 06:49:20.221016 --- ParallelTerminationStrategy: PID 19444 died... 06:49:20.239852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19444): Terminated: ok {rc=0} 06:49:20.326468 bus /sierra_3: Setting Powered False 06:49:21.425045 bus /sierra_3: Setting Powered False 06:49:22.539680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 06:49:23.798010 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:23.803014 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:49:23.841030 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:49:23.867492 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:49:23.919270 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:49:23.958678 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:49:23.986903 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:49:24.533020 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 06:49:24.539251 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:24.550652 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:24.584655 tst handover.py: using LAC 39148 06:49:24.709857 tst handover.py: using RAC 133 06:49:24.834198 tst handover.py: using CellId 39148 06:49:24.960090 tst handover.py: using BVCI 39149 06:49:25.076567 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:25.111981 tst handover.py: using LAC 39149 06:49:25.237405 tst handover.py: using RAC 134 06:49:25.361233 tst handover.py: using CellId 39149 06:49:25.486593 tst handover.py: using BVCI 39150 06:49:25.602670 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:25.613543 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:25.624102 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:25.634774 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:25.645434 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:25.656033 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:25.775804 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:25.893284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:26.355397 run create_hlr_db(pid=19450): Launched 06:49:26.483901 bus /sierra_2: Setting Powered False 06:49:27.546803 run create_hlr_db(pid=19450): Terminated: ok {rc=0} 06:49:27.977550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19452): Launched 06:49:28.316072 run osmo-hlr_10.42.42.2(pid=19453): Launched 06:49:28.446921 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:29.003114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19455): Launched 06:49:29.318483 run osmo-stp_10.42.42.5(pid=19456): Launched 06:49:29.439586 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:29.981745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19458): Launched 06:49:30.298427 run osmo-msc_10.42.42.6(pid=19459): Launched 06:49:30.476663 run osmo-stp_10.42.42.5(pid=19456): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19456)] 06:49:30.609324 run osmo-stp_10.42.42.5(pid=19456): stdout: | (launched: 2022-12-14_06:49:29.260427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:30.742074 run osmo-stp_10.42.42.5(pid=19456): stderr: | 20221214064929434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064929434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064929434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064929435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064929437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064929437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064929437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:30.883311 run osmo-stp_10.42.42.5(pid=19456): stdout: | (launched: 2022-12-14_06:49:29.260427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:31.038193 run osmo-stp_10.42.42.5(pid=19456): stderr: | 20221214064929434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064929434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064929434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064929435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064929437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064929437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064929437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:31.204537 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19456): Process ended prematurely: osmo-stp_10.42.42.5(pid=19456) [trial-2400↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19456)] [trial-2400↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 06:49:31.214782 tst handover.py:18: Test FAILED (6.7 sec) 06:49:31.243961 run osmo-hlr_10.42.42.2(pid=19453): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19453)] 06:49:31.299611 run osmo-hlr_10.42.42.2(pid=19453): stdout: | (launched: 2022-12-14_06:49:28.254375) 06:49:31.355356 run osmo-hlr_10.42.42.2(pid=19453): stderr: | 20221214064928456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064928456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064928456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064928456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064928456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064928456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064928469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064928478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064928478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064928478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:31.432449 run osmo-msc_10.42.42.6(pid=19459): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19459)] 06:49:31.484938 run osmo-msc_10.42.42.6(pid=19459): stdout: | (launched: 2022-12-14_06:49:30.239750) 06:49:31.540358 run osmo-msc_10.42.42.6(pid=19459): stderr: | 20221214064930514 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064930514 DLGLOBAL DEBUG validating counter group 0x7f996425ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064930514 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064930514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064930514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064930514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064930516 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064930517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064930517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064930517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:31.594999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19452): Terminating (SIGTERM) 06:49:31.640922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19455): Terminating (SIGTERM) 06:49:31.686625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19458): Terminating (SIGTERM) 06:49:31.733455 --- ParallelTerminationStrategy: PID 19452 died... 06:49:31.755946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19452): Terminated: ok {rc=0} 06:49:31.808128 --- ParallelTerminationStrategy: PID 19455 died... 06:49:31.829127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19455): Terminated: ok {rc=0} 06:49:31.879244 --- ParallelTerminationStrategy: PID 19458 died... 06:49:31.901075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19458): Terminated: ok {rc=0} 06:49:31.994156 bus /sierra_3: Setting Powered False 06:49:33.091378 bus /sierra_3: Setting Powered False 06:49:34.208662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 06:49:35.451964 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:35.458161 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:49:35.508257 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:49:35.534925 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:49:35.587114 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:49:35.640319 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:49:35.667628 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:49:36.215706 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 06:49:36.221973 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:36.233462 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:36.267491 tst handover.py: using LAC 39150 06:49:36.392197 tst handover.py: using RAC 135 06:49:36.521393 tst handover.py: using CellId 39150 06:49:36.643935 tst handover.py: using BVCI 39151 06:49:36.761168 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:36.813363 tst handover.py: using LAC 39151 06:49:36.938568 tst handover.py: using RAC 136 06:49:37.065344 tst handover.py: using CellId 39151 06:49:37.189475 tst handover.py: using BVCI 39152 06:49:37.306243 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:37.317377 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:37.328630 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:37.339588 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:37.350561 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:37.361472 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:49:37.479515 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:49:37.600495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:38.093282 run create_hlr_db(pid=19464): Launched 06:49:38.222200 bus /sierra_2: Setting Powered False 06:49:39.287816 run create_hlr_db(pid=19464): Terminated: ok {rc=0} 06:49:39.725391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19466): Launched 06:49:40.062597 run osmo-hlr_10.42.42.2(pid=19467): Launched 06:49:40.193116 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:40.746973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19469): Launched 06:49:41.083824 run osmo-stp_10.42.42.5(pid=19470): Launched 06:49:41.215421 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:41.793710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19472): Launched 06:49:42.129910 run osmo-msc_10.42.42.6(pid=19473): Launched 06:49:42.319829 run osmo-stp_10.42.42.5(pid=19470): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19470)] 06:49:42.461141 run osmo-stp_10.42.42.5(pid=19470): stdout: | (launched: 2022-12-14_06:49:41.022306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:42.602332 run osmo-stp_10.42.42.5(pid=19470): stderr: | 20221214064941216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064941216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064941217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064941217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064941219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064941220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064941220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:42.741974 run osmo-stp_10.42.42.5(pid=19470): stdout: | (launched: 2022-12-14_06:49:41.022306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:42.875804 run osmo-stp_10.42.42.5(pid=19470): stderr: | 20221214064941216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064941216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064941217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064941217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064941219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064941220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064941220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:43.035506 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19470): Process ended prematurely: osmo-stp_10.42.42.5(pid=19470) [trial-2400↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19470)] [trial-2400↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 06:49:43.044709 tst handover.py:18: Test FAILED (6.8 sec) 06:49:43.072033 run osmo-hlr_10.42.42.2(pid=19467): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19467)] 06:49:43.122660 run osmo-hlr_10.42.42.2(pid=19467): stdout: | (launched: 2022-12-14_06:49:40.001182) 06:49:43.174874 run osmo-hlr_10.42.42.2(pid=19467): stderr: | 20221214064940199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064940199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064940199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064940199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064940199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064940199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064940212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064940220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064940220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064940221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:43.247553 run osmo-msc_10.42.42.6(pid=19473): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19473)] 06:49:43.297593 run osmo-msc_10.42.42.6(pid=19473): stdout: | (launched: 2022-12-14_06:49:42.068481) 06:49:43.349584 run osmo-msc_10.42.42.6(pid=19473): stderr: | 20221214064942392 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064942392 DLGLOBAL DEBUG validating counter group 0x7ff2d16c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064942392 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064942392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064942393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064942393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064942394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064942395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064942395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064942395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:43.401355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19466): Terminating (SIGTERM) 06:49:43.443381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19469): Terminating (SIGTERM) 06:49:43.485534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19472): Terminating (SIGTERM) 06:49:43.527576 --- ParallelTerminationStrategy: PID 19466 died... 06:49:43.548005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19466): Terminated: ok {rc=0} 06:49:43.594676 --- ParallelTerminationStrategy: PID 19469 died... 06:49:43.614580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19469): Terminated: ok {rc=0} 06:49:43.660455 --- ParallelTerminationStrategy: PID 19472 died... 06:49:43.680369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19472): Terminated: ok {rc=0} 06:49:43.768509 bus /sierra_3: Setting Powered False 06:49:44.866306 bus /sierra_3: Setting Powered False 06:49:46.000336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 06:49:47.279379 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:47.285081 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:49:47.336540 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:49:47.363774 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:49:47.415315 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:49:47.466760 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:49:47.493818 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:49:48.042853 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 06:49:48.048376 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:48.059466 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:49:48.093138 tst handover.py: using LAC 39152 06:49:48.225388 tst handover.py: using RAC 137 06:49:48.355357 tst handover.py: using CellId 39152 06:49:48.484887 tst handover.py: using BVCI 39153 06:49:48.607440 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:49:48.654970 tst handover.py: using LAC 39153 06:49:48.778262 tst handover.py: using RAC 138 06:49:48.909470 tst handover.py: using CellId 39153 06:49:49.033155 tst handover.py: using BVCI 39154 06:49:49.147624 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:49.158673 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:49.169412 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:49.180290 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:49.191217 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:49.202071 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:49:49.319477 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:49:49.441194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:49.933191 run create_hlr_db(pid=19479): Launched 06:49:50.063373 bus /sierra_2: Setting Powered False 06:49:51.129408 run create_hlr_db(pid=19479): Terminated: ok {rc=0} 06:49:51.568081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19481): Launched 06:49:51.905663 run osmo-hlr_10.42.42.2(pid=19482): Launched 06:49:52.035264 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:52.584888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19484): Launched 06:49:52.921946 run osmo-stp_10.42.42.5(pid=19485): Launched 06:49:53.051113 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:53.629755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19487): Launched 06:49:53.965662 run osmo-msc_10.42.42.6(pid=19488): Launched 06:49:54.155200 run osmo-stp_10.42.42.5(pid=19485): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19485)] 06:49:54.299658 run osmo-stp_10.42.42.5(pid=19485): stdout: | (launched: 2022-12-14_06:49:52.860047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:54.439605 run osmo-stp_10.42.42.5(pid=19485): stderr: | 20221214064953057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064953057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064953057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064953058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064953058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064953058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064953058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:54.578533 run osmo-stp_10.42.42.5(pid=19485): stdout: | (launched: 2022-12-14_06:49:52.860047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:54.712146 run osmo-stp_10.42.42.5(pid=19485): stderr: | 20221214064953057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214064953057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214064953057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214064953058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214064953058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214064953058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214064953058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:54.871784 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19485): Process ended prematurely: osmo-stp_10.42.42.5(pid=19485) [trial-2400↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19485)] [trial-2400↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 06:49:54.880656 tst handover.py:18: Test FAILED (6.8 sec) 06:49:54.908127 run osmo-hlr_10.42.42.2(pid=19482): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19482)] 06:49:54.958669 run osmo-hlr_10.42.42.2(pid=19482): stdout: | (launched: 2022-12-14_06:49:51.843745) 06:49:55.010818 run osmo-hlr_10.42.42.2(pid=19482): stderr: | 20221214064952044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214064952044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214064952044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214064952044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214064952044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214064952044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214064952056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214064952064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214064952065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214064952065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:55.083470 run osmo-msc_10.42.42.6(pid=19488): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19488)] 06:49:55.133347 run osmo-msc_10.42.42.6(pid=19488): stdout: | (launched: 2022-12-14_06:49:53.903981) 06:49:55.185346 run osmo-msc_10.42.42.6(pid=19488): stderr: | 20221214064954228 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214064954228 DLGLOBAL DEBUG validating counter group 0x7f956f8c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214064954228 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214064954228 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214064954229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214064954229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214064954230 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214064954231 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214064954231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214064954231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:55.238066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19481): Terminating (SIGTERM) 06:49:55.280068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19484): Terminating (SIGTERM) 06:49:55.322167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19487): Terminating (SIGTERM) 06:49:55.364499 --- ParallelTerminationStrategy: PID 19481 died... 06:49:55.384714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19481): Terminated: ok {rc=0} 06:49:55.430772 --- ParallelTerminationStrategy: PID 19484 died... 06:49:55.450502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19484): Terminated: ok {rc=0} 06:49:55.496549 --- ParallelTerminationStrategy: PID 19487 died... 06:49:55.516475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19487): Terminated: ok {rc=0} 06:49:55.605220 bus /sierra_3: Setting Powered False 06:49:56.703376 bus /sierra_3: Setting Powered False 06:49:57.816460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 06:49:59.079510 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:59.085527 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:49:59.136100 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:49:59.163730 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:49:59.215914 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:49:59.266602 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:49:59.294065 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:49:59.847218 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 06:49:59.853264 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:49:59.864674 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:49:59.898856 tst handover.py: using LAC 39154 06:50:00.029855 tst handover.py: using RAC 139 06:50:00.162587 tst handover.py: using CellId 39154 06:50:00.295221 tst handover.py: using BVCI 39155 06:50:00.418062 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:50:00.468908 tst handover.py: using LAC 39155 06:50:00.605222 tst handover.py: using RAC 140 06:50:00.736730 tst handover.py: using CellId 39155 06:50:00.875942 tst handover.py: using BVCI 39156 06:50:01.009408 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:50:01.021361 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:50:01.033269 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:50:01.045495 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:50:01.057285 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:50:01.068532 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:50:01.192862 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:50:01.311753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:01.802373 run create_hlr_db(pid=19496): Launched 06:50:01.968754 bus /sierra_2: Setting Powered False 06:50:03.031609 run create_hlr_db(pid=19496): Terminated: ok {rc=0} 06:50:03.442400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19498): Launched 06:50:03.757451 run osmo-hlr_10.42.42.2(pid=19499): Launched 06:50:03.876697 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:04.408335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19501): Launched 06:50:04.723344 run osmo-stp_10.42.42.5(pid=19502): Launched 06:50:04.844874 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:05.393549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19504): Launched 06:50:05.709279 run osmo-msc_10.42.42.6(pid=19505): Launched 06:50:05.885601 run osmo-stp_10.42.42.5(pid=19502): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19502)] 06:50:06.018526 run osmo-stp_10.42.42.5(pid=19502): stdout: | (launched: 2022-12-14_06:50:04.665145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:06.151187 run osmo-stp_10.42.42.5(pid=19502): stderr: | 20221214065004839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065004839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065004839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065004839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065004840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065004840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065004840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:06.281820 run osmo-stp_10.42.42.5(pid=19502): stdout: | (launched: 2022-12-14_06:50:04.665145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:06.406815 run osmo-stp_10.42.42.5(pid=19502): stderr: | 20221214065004839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065004839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065004839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065004839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065004840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065004840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065004840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:06.556435 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19502): Process ended prematurely: osmo-stp_10.42.42.5(pid=19502) [trial-2400↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19502)] [trial-2400↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 06:50:06.564994 tst handover.py:18: Test FAILED (6.7 sec) 06:50:06.591165 run osmo-hlr_10.42.42.2(pid=19499): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19499)] 06:50:06.639164 run osmo-hlr_10.42.42.2(pid=19499): stdout: | (launched: 2022-12-14_06:50:03.699515) 06:50:06.688104 run osmo-hlr_10.42.42.2(pid=19499): stderr: | 20221214065003877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065003877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065003877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065003877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065003877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065003877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065003889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065003897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065003897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065003897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:06.756510 run osmo-msc_10.42.42.6(pid=19505): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19505)] 06:50:06.803688 run osmo-msc_10.42.42.6(pid=19505): stdout: | (launched: 2022-12-14_06:50:05.650843) 06:50:06.852854 run osmo-msc_10.42.42.6(pid=19505): stderr: | 20221214065005923 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065005924 DLGLOBAL DEBUG validating counter group 0x7f77c0056c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065005924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065005924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065005924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065005924 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065005926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065005926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065005926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065005927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:06.902293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19498): Terminating (SIGTERM) 06:50:06.941557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19501): Terminating (SIGTERM) 06:50:06.981598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19504): Terminating (SIGTERM) 06:50:07.021307 --- ParallelTerminationStrategy: PID 19498 died... 06:50:07.040294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19498): Terminated: ok {rc=0} 06:50:07.084280 --- ParallelTerminationStrategy: PID 19501 died... 06:50:07.102973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19501): Terminated: ok {rc=0} 06:50:07.146647 --- ParallelTerminationStrategy: PID 19504 died... 06:50:07.165224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19504): Terminated: ok {rc=0} 06:50:07.248077 bus /sierra_3: Setting Powered False 06:50:08.346315 bus /sierra_3: Setting Powered False 06:50:09.464062 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:50:10.718242 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:10.724107 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:50:10.770698 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:50:10.797716 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:50:10.848613 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:50:10.893760 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:50:10.920386 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:50:11.474848 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:50:11.480159 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:50:11.491361 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:50:11.524213 tst handover.py: using LAC 39156 06:50:11.645982 tst handover.py: using RAC 141 06:50:11.768038 tst handover.py: using CellId 39156 06:50:11.891747 tst handover.py: using BVCI 39157 06:50:12.007561 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:50:12.051477 tst handover.py: using LAC 39157 06:50:12.183317 tst handover.py: using RAC 142 06:50:12.309376 tst handover.py: using CellId 39157 06:50:12.432887 tst handover.py: using BVCI 39158 06:50:12.547555 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:50:12.558754 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:50:12.569662 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:50:12.580539 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:50:12.591516 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:50:12.602480 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:50:12.724864 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:50:12.848008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:13.340462 run create_hlr_db(pid=19510): Launched 06:50:13.470929 bus /sierra_2: Setting Powered False 06:50:14.536597 run create_hlr_db(pid=19510): Terminated: ok {rc=0} 06:50:14.974736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19512): Launched 06:50:15.312190 run osmo-hlr_10.42.42.2(pid=19513): Launched 06:50:15.441413 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:16.014443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19515): Launched 06:50:16.353168 run osmo-stp_10.42.42.5(pid=19516): Launched 06:50:16.657287 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:17.221707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19518): Launched 06:50:17.542343 run osmo-msc_10.42.42.6(pid=19519): Launched 06:50:17.719631 run osmo-stp_10.42.42.5(pid=19516): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19516)] 06:50:17.852342 run osmo-stp_10.42.42.5(pid=19516): stdout: | (launched: 2022-12-14_06:50:16.291689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:17.985706 run osmo-stp_10.42.42.5(pid=19516): stderr: | 20221214065016514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065016514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065016515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065016515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065016516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065016516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065016516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:18.116492 run osmo-stp_10.42.42.5(pid=19516): stdout: | (launched: 2022-12-14_06:50:16.291689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:18.241442 run osmo-stp_10.42.42.5(pid=19516): stderr: | 20221214065016514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065016514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065016515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065016515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065016516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065016516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065016516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:18.390907 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19516): Process ended prematurely: osmo-stp_10.42.42.5(pid=19516) [trial-2400↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19516)] [trial-2400↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 06:50:18.399255 tst handover.py:18: Test FAILED (6.9 sec) 06:50:18.425246 run osmo-hlr_10.42.42.2(pid=19513): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19513)] 06:50:18.472268 run osmo-hlr_10.42.42.2(pid=19513): stdout: | (launched: 2022-12-14_06:50:15.250391) 06:50:18.521310 run osmo-hlr_10.42.42.2(pid=19513): stderr: | 20221214065015449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065015449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065015449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065015449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065015449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065015449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065015462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065015470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065015470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065015470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:18.589855 run osmo-msc_10.42.42.6(pid=19519): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19519)] 06:50:18.637063 run osmo-msc_10.42.42.6(pid=19519): stdout: | (launched: 2022-12-14_06:50:17.482969) 06:50:18.686086 run osmo-msc_10.42.42.6(pid=19519): stderr: | 20221214065017755 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065017755 DLGLOBAL DEBUG validating counter group 0x7f52c7856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065017755 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065017756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065017756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065017756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065017758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065017758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065017758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065017758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:18.735327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19512): Terminating (SIGTERM) 06:50:18.774796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19515): Terminating (SIGTERM) 06:50:18.814420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19518): Terminating (SIGTERM) 06:50:18.854286 --- ParallelTerminationStrategy: PID 19512 died... 06:50:18.873390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19512): Terminated: ok {rc=0} 06:50:18.917155 --- ParallelTerminationStrategy: PID 19515 died... 06:50:18.935725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19515): Terminated: ok {rc=0} 06:50:18.979315 --- ParallelTerminationStrategy: PID 19518 died... 06:50:18.997857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19518): Terminated: ok {rc=0} 06:50:19.083766 bus /sierra_3: Setting Powered False 06:50:20.182616 bus /sierra_3: Setting Powered False 06:50:21.295647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:50:22.543208 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:22.548379 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:50:22.597567 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:50:22.623941 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:50:22.676093 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:50:22.727181 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:50:22.754727 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:50:23.306693 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:50:23.312551 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:23.324317 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:50:23.358807 tst handover.py: using LAC 39158 06:50:23.489430 tst handover.py: using RAC 143 06:50:23.614110 tst handover.py: using CellId 39158 06:50:23.739803 tst handover.py: using BVCI 39159 06:50:23.855947 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:50:23.904817 tst handover.py: using LAC 39159 06:50:24.028313 tst handover.py: using RAC 144 06:50:24.153417 tst handover.py: using CellId 39159 06:50:24.279568 tst handover.py: using BVCI 39160 06:50:24.395883 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.406958 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.417834 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.428601 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.439484 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.450364 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:50:24.571021 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:50:24.689402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:25.152169 run create_hlr_db(pid=19524): Launched 06:50:25.279110 bus /sierra_2: Setting Powered False 06:50:26.340798 run create_hlr_db(pid=19524): Terminated: ok {rc=0} 06:50:26.750697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19526): Launched 06:50:27.064295 run osmo-hlr_10.42.42.2(pid=19527): Launched 06:50:27.185552 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:27.713304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19529): Launched 06:50:28.026410 run osmo-stp_10.42.42.5(pid=19530): Launched 06:50:28.146504 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:28.686450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19532): Launched 06:50:29.000917 run osmo-msc_10.42.42.6(pid=19533): Launched 06:50:29.178515 run osmo-stp_10.42.42.5(pid=19530): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19530)] 06:50:29.310966 run osmo-stp_10.42.42.5(pid=19530): stdout: | (launched: 2022-12-14_06:50:27.968426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:29.442842 run osmo-stp_10.42.42.5(pid=19530): stderr: | 20221214065028142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065028142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065028143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065028143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065028143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065028143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065028144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:29.572504 run osmo-stp_10.42.42.5(pid=19530): stdout: | (launched: 2022-12-14_06:50:27.968426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:29.697088 run osmo-stp_10.42.42.5(pid=19530): stderr: | 20221214065028142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065028142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065028143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065028143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065028143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065028143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065028144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:29.846376 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19530): Process ended prematurely: osmo-stp_10.42.42.5(pid=19530) [trial-2400↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19530)] [trial-2400↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 06:50:29.854621 tst handover.py:18: Test FAILED (6.5 sec) 06:50:29.880498 run osmo-hlr_10.42.42.2(pid=19527): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19527)] 06:50:29.927350 run osmo-hlr_10.42.42.2(pid=19527): stdout: | (launched: 2022-12-14_06:50:27.006257) 06:50:29.976290 run osmo-hlr_10.42.42.2(pid=19527): stderr: | 20221214065027186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065027186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065027186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065027186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065027186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065027186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065027198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065027206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065027206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065027206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:30.044474 run osmo-msc_10.42.42.6(pid=19533): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19533)] 06:50:30.091339 run osmo-msc_10.42.42.6(pid=19533): stdout: | (launched: 2022-12-14_06:50:28.942550) 06:50:30.140096 run osmo-msc_10.42.42.6(pid=19533): stderr: | 20221214065029215 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065029216 DLGLOBAL DEBUG validating counter group 0x7fbe491a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065029216 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065029216 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065029216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065029216 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065029218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065029218 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065029219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065029219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:30.189197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19526): Terminating (SIGTERM) 06:50:30.228553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19529): Terminating (SIGTERM) 06:50:30.267677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19532): Terminating (SIGTERM) 06:50:30.307117 --- ParallelTerminationStrategy: PID 19526 died... 06:50:30.326167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19526): Terminated: ok {rc=0} 06:50:30.369513 --- ParallelTerminationStrategy: PID 19529 died... 06:50:30.387931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19529): Terminated: ok {rc=0} 06:50:30.431159 --- ParallelTerminationStrategy: PID 19532 died... 06:50:30.449664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19532): Terminated: ok {rc=0} 06:50:30.534613 bus /sierra_3: Setting Powered False 06:50:31.636255 bus /sierra_3: Setting Powered False 06:50:32.757060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 06:50:34.018021 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:34.023137 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:50:34.062848 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:50:34.091539 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:50:34.144852 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:50:34.182790 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:50:34.210122 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:50:34.760668 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 06:50:34.766224 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:34.777501 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 06:50:34.810538 tst handover.py: using LAC 39160 06:50:34.935972 tst handover.py: using RAC 145 06:50:35.062284 tst handover.py: using CellId 39160 06:50:35.190476 tst handover.py: using BVCI 39161 06:50:35.306436 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 06:50:35.340095 tst handover.py: using LAC 39161 06:50:35.461725 tst handover.py: using RAC 146 06:50:35.583412 tst handover.py: using CellId 39161 06:50:35.707291 tst handover.py: using BVCI 39162 06:50:35.833106 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.844337 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.856385 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.867544 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.879495 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.891396 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 06:50:36.010488 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 06:50:36.133532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:36.595701 run create_hlr_db(pid=19538): Launched 06:50:36.724219 bus /sierra_2: Setting Powered False 06:50:37.787096 run create_hlr_db(pid=19538): Terminated: ok {rc=0} 06:50:38.197366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19540): Launched 06:50:38.512767 run osmo-hlr_10.42.42.2(pid=19541): Launched 06:50:38.633129 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:39.163570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19543): Launched 06:50:39.479018 run osmo-stp_10.42.42.5(pid=19544): Launched 06:50:39.600089 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:40.141730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19546): Launched 06:50:40.455893 run osmo-msc_10.42.42.6(pid=19547): Launched 06:50:40.631463 run osmo-stp_10.42.42.5(pid=19544): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19544)] 06:50:40.763166 run osmo-stp_10.42.42.5(pid=19544): stdout: | (launched: 2022-12-14_06:50:39.420878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:40.894918 run osmo-stp_10.42.42.5(pid=19544): stderr: | 20221214065039592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065039592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065039592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065039593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065039593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065039593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065039593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:41.024545 run osmo-stp_10.42.42.5(pid=19544): stdout: | (launched: 2022-12-14_06:50:39.420878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:41.149251 run osmo-stp_10.42.42.5(pid=19544): stderr: | 20221214065039592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065039592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065039592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065039593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065039593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065039593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065039593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:41.298725 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19544): Process ended prematurely: osmo-stp_10.42.42.5(pid=19544) [trial-2400↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19544)] [trial-2400↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 06:50:41.307028 tst handover.py:18: Test FAILED (6.5 sec) 06:50:41.332913 run osmo-hlr_10.42.42.2(pid=19541): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19541)] 06:50:41.380240 run osmo-hlr_10.42.42.2(pid=19541): stdout: | (launched: 2022-12-14_06:50:38.454041) 06:50:41.429312 run osmo-hlr_10.42.42.2(pid=19541): stderr: | 20221214065038632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065038632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065038632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065038632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065038632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065038632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065038645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065038654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065038654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065038654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:41.497669 run osmo-msc_10.42.42.6(pid=19547): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19547)] 06:50:41.544669 run osmo-msc_10.42.42.6(pid=19547): stdout: | (launched: 2022-12-14_06:50:40.397861) 06:50:41.593347 run osmo-msc_10.42.42.6(pid=19547): stderr: | 20221214065040669 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065040670 DLGLOBAL DEBUG validating counter group 0x7fcdf6a00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065040670 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065040670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065040670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065040670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065040672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065040672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065040672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065040672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:41.642497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19540): Terminating (SIGTERM) 06:50:41.681854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19543): Terminating (SIGTERM) 06:50:41.721088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19546): Terminating (SIGTERM) 06:50:41.760454 --- ParallelTerminationStrategy: PID 19540 died... 06:50:41.779476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19540): Terminated: ok {rc=0} 06:50:41.823060 --- ParallelTerminationStrategy: PID 19543 died... 06:50:41.841514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19543): Terminated: ok {rc=0} 06:50:41.892715 --- ParallelTerminationStrategy: PID 19546 died... 06:50:41.928426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19546): Terminated: ok {rc=0} 06:50:42.013211 bus /sierra_3: Setting Powered False 06:50:43.111503 bus /sierra_3: Setting Powered False 06:50:44.224360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 06:50:45.464800 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:45.470929 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:50:45.521561 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:50:45.548823 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:50:45.601089 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:50:45.651393 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:50:45.678507 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:50:46.225178 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 06:50:46.232343 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:46.244279 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:46.279140 tst handover.py: using LAC 39162 06:50:46.450056 tst handover.py: using RAC 147 06:50:46.612081 tst handover.py: using CellId 39162 06:50:46.779443 tst handover.py: using BVCI 39163 06:50:46.899471 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:46.948883 tst handover.py: using LAC 39163 06:50:47.105785 tst handover.py: using RAC 148 06:50:47.264902 tst handover.py: using CellId 39163 06:50:47.402712 tst handover.py: using BVCI 39164 06:50:47.527476 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.538815 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.549965 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.561098 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.572490 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.583963 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:47.702068 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:47.824213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:48.317952 run create_hlr_db(pid=19552): Launched 06:50:48.444869 bus /sierra_2: Setting Powered False 06:50:49.507157 run create_hlr_db(pid=19552): Terminated: ok {rc=0} 06:50:49.937178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19554): Launched 06:50:50.275445 run osmo-hlr_10.42.42.2(pid=19555): Launched 06:50:50.405028 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:50.955919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19557): Launched 06:50:51.293924 run osmo-stp_10.42.42.5(pid=19558): Launched 06:50:51.423620 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:52.004236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19561): Launched 06:50:52.341438 run osmo-msc_10.42.42.6(pid=19562): Launched 06:50:52.528665 run osmo-stp_10.42.42.5(pid=19558): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19558)] 06:50:52.670289 run osmo-stp_10.42.42.5(pid=19558): stdout: | (launched: 2022-12-14_06:50:51.231967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:52.811998 run osmo-stp_10.42.42.5(pid=19558): stderr: | 20221214065051426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065051426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065051426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065051427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065051427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065051427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065051427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:52.951759 run osmo-stp_10.42.42.5(pid=19558): stdout: | (launched: 2022-12-14_06:50:51.231967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:53.085640 run osmo-stp_10.42.42.5(pid=19558): stderr: | 20221214065051426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065051426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065051426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065051427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065051427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065051427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065051427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:53.246056 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19558): Process ended prematurely: osmo-stp_10.42.42.5(pid=19558) [trial-2400↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19558)] [trial-2400↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 06:50:53.255184 tst handover.py:18: Test FAILED (7.0 sec) 06:50:53.282746 run osmo-hlr_10.42.42.2(pid=19555): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19555)] 06:50:53.334104 run osmo-hlr_10.42.42.2(pid=19555): stdout: | (launched: 2022-12-14_06:50:50.212929) 06:50:53.386531 run osmo-hlr_10.42.42.2(pid=19555): stderr: | 20221214065050413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065050413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065050413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065050413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065050413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065050414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065050426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065050434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065050434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065050434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:53.458925 run osmo-msc_10.42.42.6(pid=19562): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19562)] 06:50:53.509129 run osmo-msc_10.42.42.6(pid=19562): stdout: | (launched: 2022-12-14_06:50:52.279467) 06:50:53.560937 run osmo-msc_10.42.42.6(pid=19562): stderr: | 20221214065052602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065052602 DLGLOBAL DEBUG validating counter group 0x7f48f2364c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065052602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065052603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065052603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065052603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065052605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065052605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065052605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065052605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:53.613481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19554): Terminating (SIGTERM) 06:50:53.655290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19557): Terminating (SIGTERM) 06:50:53.697923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19561): Terminating (SIGTERM) 06:50:53.740317 --- ParallelTerminationStrategy: PID 19554 died... 06:50:53.760880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19554): Terminated: ok {rc=0} 06:50:53.807881 --- ParallelTerminationStrategy: PID 19557 died... 06:50:53.827848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19557): Terminated: ok {rc=0} 06:50:53.874650 --- ParallelTerminationStrategy: PID 19561 died... 06:50:53.894699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19561): Terminated: ok {rc=0} 06:50:53.982811 bus /sierra_3: Setting Powered False 06:50:55.082413 bus /sierra_3: Setting Powered False 06:50:56.202389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 06:50:57.459255 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:57.466057 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:50:57.516139 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:50:57.543242 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:50:57.595064 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:50:57.644754 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:50:57.674738 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:50:58.225611 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 06:50:58.231035 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:58.242438 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:58.276922 tst handover.py: using LAC 39164 06:50:58.409748 tst handover.py: using RAC 149 06:50:58.544038 tst handover.py: using CellId 39164 06:50:58.677398 tst handover.py: using BVCI 39165 06:50:58.800239 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:58.849753 tst handover.py: using LAC 39165 06:50:58.978772 tst handover.py: using RAC 150 06:50:59.102816 tst handover.py: using CellId 39165 06:50:59.229620 tst handover.py: using BVCI 39166 06:50:59.345860 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:59.356852 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:59.367934 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:59.379150 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:59.390311 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:59.401125 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:59.516712 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:59.635222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:00.096351 run create_hlr_db(pid=19567): Launched 06:51:00.224439 bus /sierra_2: Setting Powered False 06:51:01.296532 run create_hlr_db(pid=19567): Terminated: ok {rc=0} 06:51:01.719079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19569): Launched 06:51:02.055419 run osmo-hlr_10.42.42.2(pid=19570): Launched 06:51:02.256388 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:02.886699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19572): Launched 06:51:03.203741 run osmo-stp_10.42.42.5(pid=19573): Launched 06:51:03.323569 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:03.865063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19575): Launched 06:51:04.180260 run osmo-msc_10.42.42.6(pid=19576): Launched 06:51:04.356913 run osmo-stp_10.42.42.5(pid=19573): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19573)] 06:51:04.490166 run osmo-stp_10.42.42.5(pid=19573): stdout: | (launched: 2022-12-14_06:51:03.145241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:04.621795 run osmo-stp_10.42.42.5(pid=19573): stderr: | 20221214065103319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065103319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065103319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065103320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065103320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065103320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065103320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:04.751831 run osmo-stp_10.42.42.5(pid=19573): stdout: | (launched: 2022-12-14_06:51:03.145241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:04.876601 run osmo-stp_10.42.42.5(pid=19573): stderr: | 20221214065103319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065103319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065103319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065103320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065103320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065103320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065103320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:05.025899 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19573): Process ended prematurely: osmo-stp_10.42.42.5(pid=19573) [trial-2400↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19573)] [trial-2400↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 06:51:05.034143 tst handover.py:18: Test FAILED (6.8 sec) 06:51:05.060089 run osmo-hlr_10.42.42.2(pid=19570): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19570)] 06:51:05.107932 run osmo-hlr_10.42.42.2(pid=19570): stdout: | (launched: 2022-12-14_06:51:01.994218) 06:51:05.156591 run osmo-hlr_10.42.42.2(pid=19570): stderr: | 20221214065102369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065102369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065102369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065102369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065102369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065102369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065102385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065102401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065102402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065102402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:05.224599 run osmo-msc_10.42.42.6(pid=19576): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19576)] 06:51:05.271617 run osmo-msc_10.42.42.6(pid=19576): stdout: | (launched: 2022-12-14_06:51:04.121929) 06:51:05.320165 run osmo-msc_10.42.42.6(pid=19576): stderr: | 20221214065104395 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065104395 DLGLOBAL DEBUG validating counter group 0x7fc98303bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065104395 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065104395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065104395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065104396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065104397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065104398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065104398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065104398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:05.368919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19569): Terminating (SIGTERM) 06:51:05.408272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19572): Terminating (SIGTERM) 06:51:05.447715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19575): Terminating (SIGTERM) 06:51:05.487365 --- ParallelTerminationStrategy: PID 19569 died... 06:51:05.506281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19569): Terminated: ok {rc=0} 06:51:05.549858 --- ParallelTerminationStrategy: PID 19572 died... 06:51:05.568152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19572): Terminated: ok {rc=0} 06:51:05.611557 --- ParallelTerminationStrategy: PID 19575 died... 06:51:05.630118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19575): Terminated: ok {rc=0} 06:51:05.715594 bus /sierra_3: Setting Powered False 06:51:06.815537 bus /sierra_3: Setting Powered False 06:51:07.928238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:51:09.184234 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:09.190518 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:51:09.251264 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:51:09.278410 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:51:09.331116 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:51:09.391895 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:51:09.418975 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:51:09.973304 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:51:09.979017 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:51:09.990699 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:51:10.043791 tst handover.py: using LAC 39166 06:51:10.179042 tst handover.py: using RAC 151 06:51:10.312639 tst handover.py: using CellId 39166 06:51:10.444428 tst handover.py: using BVCI 39167 06:51:10.567274 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:51:10.611549 tst handover.py: using LAC 39167 06:51:10.743555 tst handover.py: using RAC 152 06:51:10.875612 tst handover.py: using CellId 39167 06:51:11.006380 tst handover.py: using BVCI 39168 06:51:11.131264 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:51:11.143034 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:51:11.154533 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:51:11.166020 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:51:11.177750 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:51:11.189367 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:51:11.308121 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:51:11.429889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:11.922724 run create_hlr_db(pid=19581): Launched 06:51:12.051507 bus /sierra_2: Setting Powered False 06:51:13.118315 run create_hlr_db(pid=19581): Terminated: ok {rc=0} 06:51:13.541986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19583): Launched 06:51:13.857543 run osmo-hlr_10.42.42.2(pid=19584): Launched 06:51:13.978064 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:14.493240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19586): Launched 06:51:14.807736 run osmo-stp_10.42.42.5(pid=19587): Launched 06:51:14.928354 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:15.471218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19589): Launched 06:51:15.788803 run osmo-msc_10.42.42.6(pid=19590): Launched 06:51:16.167138 run osmo-stp_10.42.42.5(pid=19587): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19587)] 06:51:16.329163 run osmo-stp_10.42.42.5(pid=19587): stdout: | (launched: 2022-12-14_06:51:14.749723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:16.461682 run osmo-stp_10.42.42.5(pid=19587): stderr: | 20221214065114924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065114924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065114925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065114925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065114926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065114926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065114926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:16.594762 run osmo-stp_10.42.42.5(pid=19587): stdout: | (launched: 2022-12-14_06:51:14.749723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:16.722775 run osmo-stp_10.42.42.5(pid=19587): stderr: | 20221214065114924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065114924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065114925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065114925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065114926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065114926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065114926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:16.875132 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19587): Process ended prematurely: osmo-stp_10.42.42.5(pid=19587) [trial-2400↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19587)] [trial-2400↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 06:51:16.884050 tst handover.py:18: Test FAILED (6.9 sec) 06:51:16.910947 run osmo-hlr_10.42.42.2(pid=19584): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19584)] 06:51:16.959318 run osmo-hlr_10.42.42.2(pid=19584): stdout: | (launched: 2022-12-14_06:51:13.799281) 06:51:17.009476 run osmo-hlr_10.42.42.2(pid=19584): stderr: | 20221214065113975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065113976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065113976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065113976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065113976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065113976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065113991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065114000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065114000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065114000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:17.079527 run osmo-msc_10.42.42.6(pid=19590): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19590)] 06:51:17.127754 run osmo-msc_10.42.42.6(pid=19590): stdout: | (launched: 2022-12-14_06:51:15.729911) 06:51:17.177767 run osmo-msc_10.42.42.6(pid=19590): stderr: | 20221214065116049 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065116049 DLGLOBAL DEBUG validating counter group 0x7f00581efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065116049 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065116049 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065116049 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065116050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065116051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065116052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065116052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065116052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:17.228165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19583): Terminating (SIGTERM) 06:51:17.268940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19586): Terminating (SIGTERM) 06:51:17.311367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19589): Terminating (SIGTERM) 06:51:17.352237 --- ParallelTerminationStrategy: PID 19583 died... 06:51:17.372736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19583): Terminated: ok {rc=0} 06:51:17.417248 --- ParallelTerminationStrategy: PID 19586 died... 06:51:17.436126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19586): Terminated: ok {rc=0} 06:51:17.479456 --- ParallelTerminationStrategy: PID 19589 died... 06:51:17.497998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19589): Terminated: ok {rc=0} 06:51:17.583866 bus /sierra_3: Setting Powered False 06:51:18.685495 bus /sierra_3: Setting Powered False 06:51:19.801212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:51:21.067259 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:21.072851 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:51:21.135830 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:51:21.162524 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:51:21.214387 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:51:21.280474 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:51:21.308045 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:51:21.855398 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:51:21.860581 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:51:21.871675 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:51:21.919012 tst handover.py: using LAC 39168 06:51:22.045346 tst handover.py: using RAC 153 06:51:22.168735 tst handover.py: using CellId 39168 06:51:22.290815 tst handover.py: using BVCI 39169 06:51:22.406209 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:51:22.453915 tst handover.py: using LAC 39169 06:51:22.590263 tst handover.py: using RAC 154 06:51:22.721651 tst handover.py: using CellId 39169 06:51:22.851551 tst handover.py: using BVCI 39170 06:51:22.967252 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:51:22.978413 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:51:22.989356 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:51:23.000218 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:51:23.011114 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:51:23.022072 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:51:23.141840 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:51:23.266232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:23.760029 run create_hlr_db(pid=19595): Launched 06:51:23.888490 bus /sierra_2: Setting Powered False 06:51:24.954346 run create_hlr_db(pid=19595): Terminated: ok {rc=0} 06:51:25.377694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19597): Launched 06:51:25.693911 run osmo-hlr_10.42.42.2(pid=19598): Launched 06:51:25.814070 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:26.329180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19600): Launched 06:51:26.643054 run osmo-stp_10.42.42.5(pid=19601): Launched 06:51:26.762997 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:27.305721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19603): Launched 06:51:27.622584 run osmo-msc_10.42.42.6(pid=19604): Launched 06:51:27.800056 run osmo-stp_10.42.42.5(pid=19601): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19601)] 06:51:27.933404 run osmo-stp_10.42.42.5(pid=19601): stdout: | (launched: 2022-12-14_06:51:26.585093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:28.064906 run osmo-stp_10.42.42.5(pid=19601): stderr: | 20221214065126760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065126760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065126760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065126761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065126761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065126761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065126762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:28.195166 run osmo-stp_10.42.42.5(pid=19601): stdout: | (launched: 2022-12-14_06:51:26.585093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:28.320166 run osmo-stp_10.42.42.5(pid=19601): stderr: | 20221214065126760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065126760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065126760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065126761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065126761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065126761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065126762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:28.469717 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19601): Process ended prematurely: osmo-stp_10.42.42.5(pid=19601) [trial-2400↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19601)] [trial-2400↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 06:51:28.477943 tst handover.py:18: Test FAILED (6.6 sec) 06:51:28.503959 run osmo-hlr_10.42.42.2(pid=19598): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19598)] 06:51:28.551296 run osmo-hlr_10.42.42.2(pid=19598): stdout: | (launched: 2022-12-14_06:51:25.635098) 06:51:28.600158 run osmo-hlr_10.42.42.2(pid=19598): stderr: | 20221214065125814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065125814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065125814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065125814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065125814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065125814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065125827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065125835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065125835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065125835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:28.669086 run osmo-msc_10.42.42.6(pid=19604): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19604)] 06:51:28.716508 run osmo-msc_10.42.42.6(pid=19604): stdout: | (launched: 2022-12-14_06:51:27.563294) 06:51:28.765528 run osmo-msc_10.42.42.6(pid=19604): stderr: | 20221214065127838 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065127838 DLGLOBAL DEBUG validating counter group 0x7f124f2fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065127838 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065127838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065127838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065127838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065127840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065127840 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065127841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065127841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:28.815096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19597): Terminating (SIGTERM) 06:51:28.854540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19600): Terminating (SIGTERM) 06:51:28.894106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19603): Terminating (SIGTERM) 06:51:28.933963 --- ParallelTerminationStrategy: PID 19597 died... 06:51:28.953320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19597): Terminated: ok {rc=0} 06:51:28.997249 --- ParallelTerminationStrategy: PID 19600 died... 06:51:29.015979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19600): Terminated: ok {rc=0} 06:51:29.060038 --- ParallelTerminationStrategy: PID 19603 died... 06:51:29.078754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19603): Terminated: ok {rc=0} 06:51:29.164479 bus /sierra_3: Setting Powered False 06:51:30.263372 bus /sierra_3: Setting Powered False 06:51:31.377412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 06:51:32.654569 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:32.660668 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:51:32.710904 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:51:32.737546 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:51:32.787358 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:51:32.837685 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:51:32.863963 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:51:33.419094 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 06:51:33.424910 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:33.436432 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 06:51:33.486627 tst handover.py: using LAC 39170 06:51:33.617396 tst handover.py: using RAC 155 06:51:33.747680 tst handover.py: using CellId 39170 06:51:33.878975 tst handover.py: using BVCI 39171 06:51:34.001307 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 06:51:34.035033 tst handover.py: using LAC 39171 06:51:34.165662 tst handover.py: using RAC 156 06:51:34.288918 tst handover.py: using CellId 39171 06:51:34.410847 tst handover.py: using BVCI 39172 06:51:34.526634 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:34.537779 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:34.548630 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:34.559467 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:34.570236 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:34.580800 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 06:51:34.702698 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 06:51:34.822716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:35.316138 run create_hlr_db(pid=19609): Launched 06:51:35.444653 bus /sierra_2: Setting Powered False 06:51:36.506840 run create_hlr_db(pid=19609): Terminated: ok {rc=0} 06:51:36.918837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19611): Launched 06:51:37.236289 run osmo-hlr_10.42.42.2(pid=19612): Launched 06:51:37.357481 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:37.893142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19614): Launched 06:51:38.207410 run osmo-stp_10.42.42.5(pid=19615): Launched 06:51:38.329767 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:38.873349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19618): Launched 06:51:39.187323 run osmo-msc_10.42.42.6(pid=19619): Launched 06:51:39.364195 run osmo-stp_10.42.42.5(pid=19615): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19615)] 06:51:39.497608 run osmo-stp_10.42.42.5(pid=19615): stdout: | (launched: 2022-12-14_06:51:38.149446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:39.629372 run osmo-stp_10.42.42.5(pid=19615): stderr: | 20221214065138323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065138323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065138324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065138324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065138325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065138325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065138325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:39.760291 run osmo-stp_10.42.42.5(pid=19615): stdout: | (launched: 2022-12-14_06:51:38.149446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:39.884902 run osmo-stp_10.42.42.5(pid=19615): stderr: | 20221214065138323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065138323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065138324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065138324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065138325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065138325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065138325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:40.034919 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19615): Process ended prematurely: osmo-stp_10.42.42.5(pid=19615) [trial-2400↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19615)] [trial-2400↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 06:51:40.043307 tst handover.py:18: Test FAILED (6.6 sec) 06:51:40.069328 run osmo-hlr_10.42.42.2(pid=19612): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19612)] 06:51:40.117078 run osmo-hlr_10.42.42.2(pid=19612): stdout: | (launched: 2022-12-14_06:51:37.178011) 06:51:40.165946 run osmo-hlr_10.42.42.2(pid=19612): stderr: | 20221214065137359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065137360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065137360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065137360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065137360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065137360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065137372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065137380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065137380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065137380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:40.235080 run osmo-msc_10.42.42.6(pid=19619): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19619)] 06:51:40.282432 run osmo-msc_10.42.42.6(pid=19619): stdout: | (launched: 2022-12-14_06:51:39.129205) 06:51:40.331398 run osmo-msc_10.42.42.6(pid=19619): stderr: | 20221214065139403 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065139404 DLGLOBAL DEBUG validating counter group 0x7fc5e010ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065139404 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065139404 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065139404 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065139404 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065139406 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065139406 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065139406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065139406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:40.380794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19611): Terminating (SIGTERM) 06:51:40.420372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19614): Terminating (SIGTERM) 06:51:40.459955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19618): Terminating (SIGTERM) 06:51:40.499384 --- ParallelTerminationStrategy: PID 19611 died... 06:51:40.518567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19611): Terminated: ok {rc=0} 06:51:40.562534 --- ParallelTerminationStrategy: PID 19614 died... 06:51:40.581149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19614): Terminated: ok {rc=0} 06:51:40.624839 --- ParallelTerminationStrategy: PID 19618 died... 06:51:40.643882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19618): Terminated: ok {rc=0} 06:51:40.726759 bus /sierra_3: Setting Powered False 06:51:41.824838 bus /sierra_3: Setting Powered False 06:51:42.941218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 06:51:44.197797 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:44.203926 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:51:44.267078 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:51:44.293948 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:51:44.346293 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:51:44.411050 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:51:44.438072 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:51:44.985120 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 06:51:44.991358 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:45.003042 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:51:45.051559 tst handover.py: using LAC 39172 06:51:45.175867 tst handover.py: using RAC 157 06:51:45.300083 tst handover.py: using CellId 39172 06:51:45.424798 tst handover.py: using BVCI 39173 06:51:45.540118 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:51:45.588037 tst handover.py: using LAC 39173 06:51:45.712492 tst handover.py: using RAC 158 06:51:45.838966 tst handover.py: using CellId 39173 06:51:45.985884 tst handover.py: using BVCI 39174 06:51:46.113770 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:46.126212 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:46.138545 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:46.150857 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:46.164204 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:46.177579 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:51:46.304653 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:51:46.429984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:46.945756 run create_hlr_db(pid=19624): Launched 06:51:47.109886 bus /sierra_2: Setting Powered False 06:51:48.175471 run create_hlr_db(pid=19624): Terminated: ok {rc=0} 06:51:48.613712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19626): Launched 06:51:48.951801 run osmo-hlr_10.42.42.2(pid=19627): Launched 06:51:49.082788 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:49.636059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19629): Launched 06:51:49.974997 run osmo-stp_10.42.42.5(pid=19630): Launched 06:51:50.106216 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:50.690729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19632): Launched 06:51:51.029970 run osmo-msc_10.42.42.6(pid=19633): Launched 06:51:51.219554 run osmo-stp_10.42.42.5(pid=19630): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19630)] 06:51:51.362517 run osmo-stp_10.42.42.5(pid=19630): stdout: | (launched: 2022-12-14_06:51:49.913340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:51.505313 run osmo-stp_10.42.42.5(pid=19630): stderr: | 20221214065150109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065150109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065150109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065150110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065150110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065150110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065150110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:51.645642 run osmo-stp_10.42.42.5(pid=19630): stdout: | (launched: 2022-12-14_06:51:49.913340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:51.780231 run osmo-stp_10.42.42.5(pid=19630): stderr: | 20221214065150109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065150109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065150109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065150110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065150110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065150110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065150110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:51.941559 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19630): Process ended prematurely: osmo-stp_10.42.42.5(pid=19630) [trial-2400↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19630)] [trial-2400↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 06:51:51.950657 tst handover.py:18: Test FAILED (7.0 sec) 06:51:51.978457 run osmo-hlr_10.42.42.2(pid=19627): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19627)] 06:51:52.029739 run osmo-hlr_10.42.42.2(pid=19627): stdout: | (launched: 2022-12-14_06:51:48.889953) 06:51:52.082954 run osmo-hlr_10.42.42.2(pid=19627): stderr: | 20221214065149091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065149091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065149091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065149092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065149092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065149092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065149103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065149112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065149112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065149112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:52.156298 run osmo-msc_10.42.42.6(pid=19633): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19633)] 06:51:52.206822 run osmo-msc_10.42.42.6(pid=19633): stdout: | (launched: 2022-12-14_06:51:50.967131) 06:51:52.259504 run osmo-msc_10.42.42.6(pid=19633): stderr: | 20221214065151291 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065151292 DLGLOBAL DEBUG validating counter group 0x7fa53f27ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065151292 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065151292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065151292 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065151292 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065151294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065151294 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065151294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065151294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:52.312729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19626): Terminating (SIGTERM) 06:51:52.355128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19629): Terminating (SIGTERM) 06:51:52.397675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19632): Terminating (SIGTERM) 06:51:52.440499 --- ParallelTerminationStrategy: PID 19626 died... 06:51:52.461410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19626): Terminated: ok {rc=0} 06:51:52.508557 --- ParallelTerminationStrategy: PID 19629 died... 06:51:52.528497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19629): Terminated: ok {rc=0} 06:51:52.575459 --- ParallelTerminationStrategy: PID 19632 died... 06:51:52.595590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19632): Terminated: ok {rc=0} 06:51:52.684606 bus /sierra_3: Setting Powered False 06:51:53.783363 bus /sierra_3: Setting Powered False 06:51:54.903049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 06:51:56.169904 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:56.175499 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:51:56.236922 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:51:56.263346 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:51:56.315247 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:51:56.378849 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:51:56.406031 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:51:56.953159 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 06:51:56.958469 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:56.969552 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:57.015482 tst handover.py: using LAC 39174 06:51:57.141511 tst handover.py: using RAC 159 06:51:57.266997 tst handover.py: using CellId 39174 06:51:57.392595 tst handover.py: using BVCI 39175 06:51:57.508752 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:57.555815 tst handover.py: using LAC 39175 06:51:57.681495 tst handover.py: using RAC 160 06:51:57.811208 tst handover.py: using CellId 39175 06:51:57.935059 tst handover.py: using BVCI 39176 06:51:58.049701 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:58.060793 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:58.071613 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:58.082488 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:58.093468 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:58.104246 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:58.220422 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:58.342135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:58.835414 run create_hlr_db(pid=19638): Launched 06:51:58.964103 bus /sierra_2: Setting Powered False 06:52:00.030699 run create_hlr_db(pid=19638): Terminated: ok {rc=0} 06:52:00.453599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19640): Launched 06:52:00.768876 run osmo-hlr_10.42.42.2(pid=19641): Launched 06:52:00.966942 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:01.643225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19643): Launched 06:52:02.007159 run osmo-stp_10.42.42.5(pid=19644): Launched 06:52:02.256044 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:02.879124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19646): Launched 06:52:03.216382 run osmo-msc_10.42.42.6(pid=19647): Launched 06:52:03.405747 run osmo-stp_10.42.42.5(pid=19644): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19644)] 06:52:03.546676 run osmo-stp_10.42.42.5(pid=19644): stdout: | (launched: 2022-12-14_06:52:01.944248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:03.687798 run osmo-stp_10.42.42.5(pid=19644): stderr: | 20221214065202243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065202243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065202243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065202243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065202244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065202244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065202244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:03.827184 run osmo-stp_10.42.42.5(pid=19644): stdout: | (launched: 2022-12-14_06:52:01.944248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:03.960432 run osmo-stp_10.42.42.5(pid=19644): stderr: | 20221214065202243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065202243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065202243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065202243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065202244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065202244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065202244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:04.119975 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19644): Process ended prematurely: osmo-stp_10.42.42.5(pid=19644) [trial-2400↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19644)] [trial-2400↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 06:52:04.128935 tst handover.py:18: Test FAILED (7.2 sec) 06:52:04.156202 run osmo-hlr_10.42.42.2(pid=19641): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19641)] 06:52:04.206424 run osmo-hlr_10.42.42.2(pid=19641): stdout: | (launched: 2022-12-14_06:52:00.710534) 06:52:04.257954 run osmo-hlr_10.42.42.2(pid=19641): stderr: | 20221214065200889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065200889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065200890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065200890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065200890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065200890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065200903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065200911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065200911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065200911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:04.330563 run osmo-msc_10.42.42.6(pid=19647): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19647)] 06:52:04.380149 run osmo-msc_10.42.42.6(pid=19647): stdout: | (launched: 2022-12-14_06:52:03.154396) 06:52:04.431732 run osmo-msc_10.42.42.6(pid=19647): stderr: | 20221214065203479 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065203479 DLGLOBAL DEBUG validating counter group 0x7f2e5891cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065203479 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065203480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065203480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065203480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065203482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065203482 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065203482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065203482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:04.483898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19640): Terminating (SIGTERM) 06:52:04.525579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19643): Terminating (SIGTERM) 06:52:04.567389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19646): Terminating (SIGTERM) 06:52:04.609840 --- ParallelTerminationStrategy: PID 19640 died... 06:52:04.630263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19640): Terminated: ok {rc=0} 06:52:04.676674 --- ParallelTerminationStrategy: PID 19643 died... 06:52:04.696596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19643): Terminated: ok {rc=0} 06:52:04.742892 --- ParallelTerminationStrategy: PID 19646 died... 06:52:04.762857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19646): Terminated: ok {rc=0} 06:52:04.850465 bus /sierra_3: Setting Powered False 06:52:05.949174 bus /sierra_3: Setting Powered False 06:52:07.065260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:52:08.330765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:52:08.335949 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:52:08.394172 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:52:08.420280 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:52:08.471129 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:52:08.531409 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:52:08.557870 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:52:09.110021 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:52:09.115178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:52:09.126546 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:52:09.171147 tst handover.py: using LAC 39176 06:52:09.295296 tst handover.py: using RAC 161 06:52:09.420451 tst handover.py: using CellId 39176 06:52:09.544940 tst handover.py: using BVCI 39177 06:52:09.661264 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:52:09.710165 tst handover.py: using LAC 39177 06:52:09.842699 tst handover.py: using RAC 162 06:52:09.976903 tst handover.py: using CellId 39177 06:52:10.109891 tst handover.py: using BVCI 39178 06:52:10.232470 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:52:10.244268 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:52:10.255800 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:52:10.267344 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:52:10.279279 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:52:10.291454 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:52:10.409564 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:52:10.531274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:52:11.024835 run create_hlr_db(pid=19652): Launched 06:52:11.155955 bus /sierra_2: Setting Powered False 06:52:12.221655 run create_hlr_db(pid=19652): Terminated: ok {rc=0} 06:52:12.660509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19654): Launched 06:52:12.997736 run osmo-hlr_10.42.42.2(pid=19655): Launched 06:52:13.127200 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:13.676234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19657): Launched 06:52:14.014403 run osmo-stp_10.42.42.5(pid=19658): Launched 06:52:14.144793 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:14.725495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19660): Launched 06:52:15.064716 run osmo-msc_10.42.42.6(pid=19661): Launched 06:52:15.254944 run osmo-stp_10.42.42.5(pid=19658): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19658)] 06:52:15.397247 run osmo-stp_10.42.42.5(pid=19658): stdout: | (launched: 2022-12-14_06:52:13.952108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:15.539336 run osmo-stp_10.42.42.5(pid=19658): stderr: | 20221214065214147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065214147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065214147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065214148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065214150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065214150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065214150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:15.679204 run osmo-stp_10.42.42.5(pid=19658): stdout: | (launched: 2022-12-14_06:52:13.952108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:15.812789 run osmo-stp_10.42.42.5(pid=19658): stderr: | 20221214065214147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065214147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065214147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065214148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065214150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065214150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065214150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:15.976417 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19658): Process ended prematurely: osmo-stp_10.42.42.5(pid=19658) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19658)] [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 06:52:15.986481 tst handover.py:18: Test FAILED (6.9 sec) 06:52:16.015163 run osmo-hlr_10.42.42.2(pid=19655): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19655)] 06:52:16.068644 run osmo-hlr_10.42.42.2(pid=19655): stdout: | (launched: 2022-12-14_06:52:12.935740) 06:52:16.123002 run osmo-hlr_10.42.42.2(pid=19655): stderr: | 20221214065213137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065213137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065213137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065213137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065213137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065213137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065213163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065213173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065213173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065213173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:16.198341 run osmo-msc_10.42.42.6(pid=19661): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19661)] 06:52:16.250307 run osmo-msc_10.42.42.6(pid=19661): stdout: | (launched: 2022-12-14_06:52:15.002201) 06:52:16.304729 run osmo-msc_10.42.42.6(pid=19661): stderr: | 20221214065215323 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065215323 DLGLOBAL DEBUG validating counter group 0x7fd8e8135c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065215323 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065215323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065215323 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065215324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065215326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065215326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065215326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065215327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:16.359666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19654): Terminating (SIGTERM) 06:52:16.402915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19657): Terminating (SIGTERM) 06:52:16.447250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19660): Terminating (SIGTERM) 06:52:16.492766 --- ParallelTerminationStrategy: PID 19654 died... 06:52:16.514365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19654): Terminated: ok {rc=0} 06:52:16.562571 --- ParallelTerminationStrategy: PID 19657 died... 06:52:16.583949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19657): Terminated: ok {rc=0} 06:52:16.631663 --- ParallelTerminationStrategy: PID 19660 died... 06:52:16.652582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19660): Terminated: ok {rc=0} 06:52:16.746008 bus /sierra_3: Setting Powered False 06:52:17.853446 bus /sierra_3: Setting Powered False 06:52:18.967934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 06:52:20.237635 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:52:20.243067 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:52:20.289179 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:52:20.315611 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:52:20.367793 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:52:20.415348 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:52:20.441663 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:52:20.993849 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 06:52:20.998903 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:21.009915 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 06:52:21.052871 tst handover.py: using LAC 39178 06:52:21.175446 tst handover.py: using RAC 163 06:52:21.298717 tst handover.py: using CellId 39178 06:52:21.422345 tst handover.py: using BVCI 39179 06:52:21.536690 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 06:52:21.570498 tst handover.py: using LAC 39179 06:52:21.695489 tst handover.py: using RAC 164 06:52:21.818664 tst handover.py: using CellId 39179 06:52:21.942338 tst handover.py: using BVCI 39180 06:52:22.058825 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:22.070167 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:22.080917 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:22.091922 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:22.102826 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:22.113599 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 06:52:22.234266 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 06:52:22.352190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:52:22.814080 run create_hlr_db(pid=19666): Launched 06:52:22.943711 bus /sierra_2: Setting Powered False 06:52:24.006245 run create_hlr_db(pid=19666): Terminated: ok {rc=0} 06:52:24.418341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19668): Launched 06:52:24.735920 run osmo-hlr_10.42.42.2(pid=19669): Launched 06:52:24.856054 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:25.370391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19671): Launched 06:52:25.684745 run osmo-stp_10.42.42.5(pid=19672): Launched 06:52:25.805263 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:26.346712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19674): Launched 06:52:26.664192 run osmo-msc_10.42.42.6(pid=19675): Launched 06:52:26.840626 run osmo-stp_10.42.42.5(pid=19672): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19672)] 06:52:26.973208 run osmo-stp_10.42.42.5(pid=19672): stdout: | (launched: 2022-12-14_06:52:25.626582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:27.104825 run osmo-stp_10.42.42.5(pid=19672): stderr: | 20221214065225800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065225800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065225800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065225801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065225801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065225801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065225801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:27.235112 run osmo-stp_10.42.42.5(pid=19672): stdout: | (launched: 2022-12-14_06:52:25.626582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:27.359633 run osmo-stp_10.42.42.5(pid=19672): stderr: | 20221214065225800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065225800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065225800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065225801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065225801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065225801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065225801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:27.508753 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19672): Process ended prematurely: osmo-stp_10.42.42.5(pid=19672) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19672)] [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 06:52:27.517108 tst handover.py:18: Test FAILED (6.5 sec) 06:52:27.542861 run osmo-hlr_10.42.42.2(pid=19669): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19669)] 06:52:27.589513 run osmo-hlr_10.42.42.2(pid=19669): stdout: | (launched: 2022-12-14_06:52:24.677124) 06:52:27.638150 run osmo-hlr_10.42.42.2(pid=19669): stderr: | 20221214065224854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065224854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065224854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065224854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065224854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065224854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065224867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065224875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065224875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065224876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:27.706252 run osmo-msc_10.42.42.6(pid=19675): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19675)] 06:52:27.753200 run osmo-msc_10.42.42.6(pid=19675): stdout: | (launched: 2022-12-14_06:52:26.604561) 06:52:27.801789 run osmo-msc_10.42.42.6(pid=19675): stderr: | 20221214065226878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065226878 DLGLOBAL DEBUG validating counter group 0x7f553dcc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065226878 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065226878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065226878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065226878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065226880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065226881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065226881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065226881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:27.850532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19668): Terminating (SIGTERM) 06:52:27.889662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19671): Terminating (SIGTERM) 06:52:27.929109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19674): Terminating (SIGTERM) 06:52:27.968462 --- ParallelTerminationStrategy: PID 19668 died... 06:52:27.987493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19668): Terminated: ok {rc=0} 06:52:28.031119 --- ParallelTerminationStrategy: PID 19671 died... 06:52:28.049686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19671): Terminated: ok {rc=0} 06:52:28.093689 --- ParallelTerminationStrategy: PID 19674 died... 06:52:28.112241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19674): Terminated: ok {rc=0} 06:52:28.197614 bus /sierra_3: Setting Powered False 06:52:29.295720 bus /sierra_3: Setting Powered False 06:52:30.407932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 06:52:31.667695 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:52:31.673693 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:52:31.737976 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:52:31.765689 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:52:31.820769 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:52:31.888394 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:52:31.917195 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:52:32.464257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 06:52:32.471007 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:52:32.483257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:52:32.530603 tst handover.py: using LAC 39180 06:52:32.654915 tst handover.py: using RAC 165 06:52:32.780145 tst handover.py: using CellId 39180 06:52:32.906364 tst handover.py: using BVCI 39181 06:52:33.021781 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:52:33.069018 tst handover.py: using LAC 39181 06:52:33.190513 tst handover.py: using RAC 166 06:52:33.313691 tst handover.py: using CellId 39181 06:52:33.435558 tst handover.py: using BVCI 39182 06:52:33.551948 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:52:33.563097 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:52:33.574083 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:52:33.585050 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:52:33.595934 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:52:33.606786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:52:33.721765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:52:33.845738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:52:34.309715 run create_hlr_db(pid=19680): Launched 06:52:34.438061 bus /sierra_2: Setting Powered False 06:52:35.501591 run create_hlr_db(pid=19680): Terminated: ok {rc=0} 06:52:35.931697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19682): Launched 06:52:36.269908 run osmo-hlr_10.42.42.2(pid=19683): Launched 06:52:36.401396 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:36.953014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19685): Launched 06:52:37.290249 run osmo-stp_10.42.42.5(pid=19686): Launched 06:52:37.421682 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:38.003051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19688): Launched 06:52:38.342577 run osmo-msc_10.42.42.6(pid=19689): Launched 06:52:38.533160 run osmo-stp_10.42.42.5(pid=19686): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19686)] 06:52:38.679918 run osmo-stp_10.42.42.5(pid=19686): stdout: | (launched: 2022-12-14_06:52:37.228384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:38.822068 run osmo-stp_10.42.42.5(pid=19686): stderr: | 20221214065237422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065237422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065237422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065237423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065237425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065237425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065237425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:38.962132 run osmo-stp_10.42.42.5(pid=19686): stdout: | (launched: 2022-12-14_06:52:37.228384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:39.095670 run osmo-stp_10.42.42.5(pid=19686): stderr: | 20221214065237422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065237422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065237422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065237423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065237425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065237425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065237425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:39.255550 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19686): Process ended prematurely: osmo-stp_10.42.42.5(pid=19686) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19686)] [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 06:52:39.264900 tst handover.py:18: Test FAILED (6.8 sec) 06:52:39.292382 run osmo-hlr_10.42.42.2(pid=19683): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19683)] 06:52:39.343482 run osmo-hlr_10.42.42.2(pid=19683): stdout: | (launched: 2022-12-14_06:52:36.207966) 06:52:39.395792 run osmo-hlr_10.42.42.2(pid=19683): stderr: | 20221214065236408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065236408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065236408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065236408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065236408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065236408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065236421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065236430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065236430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065236430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:39.468689 run osmo-msc_10.42.42.6(pid=19689): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19689)] 06:52:39.518581 run osmo-msc_10.42.42.6(pid=19689): stdout: | (launched: 2022-12-14_06:52:38.279455) 06:52:39.570825 run osmo-msc_10.42.42.6(pid=19689): stderr: | 20221214065238605 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065238605 DLGLOBAL DEBUG validating counter group 0x7f470c317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065238605 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065238605 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065238605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065238606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065238607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065238608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065238608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065238608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:39.623424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19682): Terminating (SIGTERM) 06:52:39.665182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19685): Terminating (SIGTERM) 06:52:39.707636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19688): Terminating (SIGTERM) 06:52:39.750039 --- ParallelTerminationStrategy: PID 19682 died... 06:52:39.770507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19682): Terminated: ok {rc=0} 06:52:39.816791 --- ParallelTerminationStrategy: PID 19685 died... 06:52:39.836698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19685): Terminated: ok {rc=0} 06:52:39.882974 --- ParallelTerminationStrategy: PID 19688 died... 06:52:39.902806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19688): Terminated: ok {rc=0} 06:52:39.993145 bus /sierra_3: Setting Powered False 06:52:41.092495 bus /sierra_3: Setting Powered False 06:52:42.208309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 06:52:43.477212 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:52:43.482313 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:52:43.540123 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:52:43.566472 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:52:43.617132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:52:43.674507 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:52:43.701407 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:52:44.254661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 06:52:44.259742 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:44.270883 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:52:44.316526 tst handover.py: using LAC 39182 06:52:44.441171 tst handover.py: using RAC 167 06:52:44.563565 tst handover.py: using CellId 39182 06:52:44.687029 tst handover.py: using BVCI 39183 06:52:44.803222 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:52:44.849702 tst handover.py: using LAC 39183 06:52:44.981805 tst handover.py: using RAC 168 06:52:45.113452 tst handover.py: using CellId 39183 06:52:45.241160 tst handover.py: using BVCI 39184 06:52:45.357972 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:45.369124 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:45.379896 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:45.390915 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:45.402316 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:45.413807 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:52:45.535367 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:52:45.654019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:52:46.170192 run create_hlr_db(pid=19694): Launched 06:52:46.337608 bus /sierra_2: Setting Powered False 06:52:47.403941 run create_hlr_db(pid=19694): Terminated: ok {rc=0} 06:52:47.827254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19696): Launched 06:52:48.144143 run osmo-hlr_10.42.42.2(pid=19697): Launched 06:52:48.265447 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:48.781221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19699): Launched 06:52:49.096044 run osmo-stp_10.42.42.5(pid=19700): Launched 06:52:49.216651 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:49.758472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19702): Launched 06:52:50.074897 run osmo-msc_10.42.42.6(pid=19703): Launched 06:52:50.253833 run osmo-stp_10.42.42.5(pid=19700): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19700)] 06:52:50.385646 run osmo-stp_10.42.42.5(pid=19700): stdout: | (launched: 2022-12-14_06:52:49.037781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:50.516787 run osmo-stp_10.42.42.5(pid=19700): stderr: | 20221214065249209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065249209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065249209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065249210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065249212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065249212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065249212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:50.646723 run osmo-stp_10.42.42.5(pid=19700): stdout: | (launched: 2022-12-14_06:52:49.037781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:50.771105 run osmo-stp_10.42.42.5(pid=19700): stderr: | 20221214065249209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065249209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065249209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065249210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065249212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065249212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065249212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:50.919886 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19700): Process ended prematurely: osmo-stp_10.42.42.5(pid=19700) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19700)] [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 06:52:50.928170 tst handover.py:18: Test FAILED (6.7 sec) 06:52:50.954166 run osmo-hlr_10.42.42.2(pid=19697): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19697)] 06:52:51.001449 run osmo-hlr_10.42.42.2(pid=19697): stdout: | (launched: 2022-12-14_06:52:48.085457) 06:52:51.050007 run osmo-hlr_10.42.42.2(pid=19697): stderr: | 20221214065248264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065248264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065248264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065248265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065248265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065248265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065248281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065248290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065248290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065248290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:51.118371 run osmo-msc_10.42.42.6(pid=19703): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19703)] 06:52:51.165512 run osmo-msc_10.42.42.6(pid=19703): stdout: | (launched: 2022-12-14_06:52:50.016205) 06:52:51.213977 run osmo-msc_10.42.42.6(pid=19703): stderr: | 20221214065250289 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065250289 DLGLOBAL DEBUG validating counter group 0x7f7582532c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065250289 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065250289 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065250289 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065250290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065250291 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065250292 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065250292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065250292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:51.263057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19696): Terminating (SIGTERM) 06:52:51.302135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19699): Terminating (SIGTERM) 06:52:51.341269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19702): Terminating (SIGTERM) 06:52:51.380527 --- ParallelTerminationStrategy: PID 19696 died... 06:52:51.399660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19696): Terminated: ok {rc=0} 06:52:51.443125 --- ParallelTerminationStrategy: PID 19699 died... 06:52:51.461631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19699): Terminated: ok {rc=0} 06:52:51.505143 --- ParallelTerminationStrategy: PID 19702 died... 06:52:51.523711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19702): Terminated: ok {rc=0} 06:52:51.609029 bus /sierra_3: Setting Powered False 06:52:52.705768 bus /sierra_3: Setting Powered False 06:52:53.818635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 06:52:55.090373 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:52:55.096109 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:52:55.149582 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:52:55.176681 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:52:55.229288 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:52:55.282423 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:52:55.309902 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:52:55.862668 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 06:52:55.868443 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:55.880274 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 06:52:55.930780 tst handover.py: using LAC 39184 06:52:56.064091 tst handover.py: using RAC 169 06:52:56.193926 tst handover.py: using CellId 39184 06:52:56.317717 tst handover.py: using BVCI 39185 06:52:56.432430 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 06:52:56.466729 tst handover.py: using LAC 39185 06:52:56.589191 tst handover.py: using RAC 170 06:52:56.711674 tst handover.py: using CellId 39185 06:52:56.834988 tst handover.py: using BVCI 39186 06:52:56.951342 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:56.962447 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:56.973308 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:56.984062 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:56.995003 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:52:57.005882 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 06:52:57.125924 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 06:52:57.246591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:52:57.741553 run create_hlr_db(pid=19708): Launched 06:52:57.870117 bus /sierra_2: Setting Powered False 06:52:58.936325 run create_hlr_db(pid=19708): Terminated: ok {rc=0} 06:52:59.376121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19710): Launched 06:52:59.713381 run osmo-hlr_10.42.42.2(pid=19711): Launched 06:52:59.842924 run osmo-stp_10.42.42.5: Starting osmo-stp 06:53:00.394889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19713): Launched 06:53:00.733502 run osmo-stp_10.42.42.5(pid=19714): Launched 06:53:00.905423 run osmo-msc_10.42.42.6: Starting osmo-msc 06:53:01.589378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19716): Launched 06:53:01.928298 run osmo-msc_10.42.42.6(pid=19717): Launched 06:53:02.344787 run osmo-stp_10.42.42.5(pid=19714): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19714)] 06:53:02.505527 run osmo-stp_10.42.42.5(pid=19714): stdout: | (launched: 2022-12-14_06:53:00.671394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:02.647550 run osmo-stp_10.42.42.5(pid=19714): stderr: | 20221214065300924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065300924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065300924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065300925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065300929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065300929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065300929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:02.787683 run osmo-stp_10.42.42.5(pid=19714): stdout: | (launched: 2022-12-14_06:53:00.671394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:02.922431 run osmo-stp_10.42.42.5(pid=19714): stderr: | 20221214065300924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065300924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065300924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065300925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065300929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065300929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065300929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:03.083375 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19714): Process ended prematurely: osmo-stp_10.42.42.5(pid=19714) [trial-2400↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19714)] [trial-2400↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 06:53:03.092286 tst handover.py:18: Test FAILED (7.2 sec) 06:53:03.120018 run osmo-hlr_10.42.42.2(pid=19711): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19711)] 06:53:03.170751 run osmo-hlr_10.42.42.2(pid=19711): stdout: | (launched: 2022-12-14_06:52:59.651396) 06:53:03.223212 run osmo-hlr_10.42.42.2(pid=19711): stderr: | 20221214065259853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065259853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065259853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065259853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065259853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065259853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065259864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065259872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065259873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065259873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:53:03.296034 run osmo-msc_10.42.42.6(pid=19717): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19717)] 06:53:03.346271 run osmo-msc_10.42.42.6(pid=19717): stdout: | (launched: 2022-12-14_06:53:01.866019) 06:53:03.398440 run osmo-msc_10.42.42.6(pid=19717): stderr: | 20221214065302301 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065302301 DLGLOBAL DEBUG validating counter group 0x7efde6260c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065302301 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065302301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065302301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065302302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065302303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065302304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065302304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065302304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:53:03.450834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19710): Terminating (SIGTERM) 06:53:03.492676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19713): Terminating (SIGTERM) 06:53:03.535225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19716): Terminating (SIGTERM) 06:53:03.577854 --- ParallelTerminationStrategy: PID 19710 died... 06:53:03.598336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19710): Terminated: ok {rc=0} 06:53:03.645279 --- ParallelTerminationStrategy: PID 19713 died... 06:53:03.665093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19713): Terminated: ok {rc=0} 06:53:03.711877 --- ParallelTerminationStrategy: PID 19716 died... 06:53:03.732033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19716): Terminated: ok {rc=0} 06:53:03.821599 bus /sierra_3: Setting Powered False 06:53:04.920090 bus /sierra_3: Setting Powered False 06:53:06.035579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 06:53:07.297828 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:53:07.303622 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:53:07.369634 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:53:07.396725 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:53:07.450516 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:53:07.519773 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:53:07.546895 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:53:08.093755 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 06:53:08.100555 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:08.113073 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:53:08.165064 tst handover.py: using LAC 39186 06:53:08.295822 tst handover.py: using RAC 171 06:53:08.428618 tst handover.py: using CellId 39186 06:53:08.558953 tst handover.py: using BVCI 39187 06:53:08.682211 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:53:08.730366 tst handover.py: using LAC 39187 06:53:08.862296 tst handover.py: using RAC 172 06:53:08.992076 tst handover.py: using CellId 39187 06:53:09.122587 tst handover.py: using BVCI 39188 06:53:09.245517 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:09.256906 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:09.268612 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:09.279966 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:09.291591 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:09.303225 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:53:09.426624 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:53:09.543946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:53:10.007768 run create_hlr_db(pid=19722): Launched 06:53:10.137591 bus /sierra_2: Setting Powered False 06:53:11.199011 run create_hlr_db(pid=19722): Terminated: ok {rc=0} 06:53:11.610621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19724): Launched 06:53:11.925388 run osmo-hlr_10.42.42.2(pid=19725): Launched 06:53:12.045428 run osmo-stp_10.42.42.5: Starting osmo-stp 06:53:12.561828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19727): Launched 06:53:12.875840 run osmo-stp_10.42.42.5(pid=19728): Launched 06:53:12.997108 run osmo-msc_10.42.42.6: Starting osmo-msc 06:53:13.540807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19730): Launched 06:53:13.856386 run osmo-msc_10.42.42.6(pid=19731): Launched 06:53:14.032592 run osmo-stp_10.42.42.5(pid=19728): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19728)] 06:53:14.164743 run osmo-stp_10.42.42.5(pid=19728): stdout: | (launched: 2022-12-14_06:53:12.817658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:14.296378 run osmo-stp_10.42.42.5(pid=19728): stderr: | 20221214065312991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065312991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065312991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065312991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065312992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065312992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065312992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:14.428504 run osmo-stp_10.42.42.5(pid=19728): stdout: | (launched: 2022-12-14_06:53:12.817658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:14.553918 run osmo-stp_10.42.42.5(pid=19728): stderr: | 20221214065312991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065312991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065312991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065312991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065312992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065312992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065312992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:14.702876 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19728): Process ended prematurely: osmo-stp_10.42.42.5(pid=19728) [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19728)] [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 06:53:14.711168 tst handover.py:18: Test FAILED (6.6 sec) 06:53:14.737190 run osmo-hlr_10.42.42.2(pid=19725): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19725)] 06:53:14.784800 run osmo-hlr_10.42.42.2(pid=19725): stdout: | (launched: 2022-12-14_06:53:11.867129) 06:53:14.833778 run osmo-hlr_10.42.42.2(pid=19725): stderr: | 20221214065312045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065312045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065312045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065312045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065312045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065312045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065312057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065312066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065312066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065312066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:53:14.901732 run osmo-msc_10.42.42.6(pid=19731): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19731)] 06:53:14.948857 run osmo-msc_10.42.42.6(pid=19731): stdout: | (launched: 2022-12-14_06:53:13.797777) 06:53:14.997239 run osmo-msc_10.42.42.6(pid=19731): stderr: | 20221214065314071 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065314071 DLGLOBAL DEBUG validating counter group 0x7efd51d69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065314071 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065314071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065314072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065314072 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065314074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065314074 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065314074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065314074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:53:15.046227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19724): Terminating (SIGTERM) 06:53:15.085179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19727): Terminating (SIGTERM) 06:53:15.124271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19730): Terminating (SIGTERM) 06:53:15.163652 --- ParallelTerminationStrategy: PID 19724 died... 06:53:15.182656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19724): Terminated: ok {rc=0} 06:53:15.225946 --- ParallelTerminationStrategy: PID 19727 died... 06:53:15.244516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19727): Terminated: ok {rc=0} 06:53:15.287713 --- ParallelTerminationStrategy: PID 19730 died... 06:53:15.306123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19730): Terminated: ok {rc=0} 06:53:15.389204 bus /sierra_3: Setting Powered False 06:53:16.488296 bus /sierra_3: Setting Powered False 06:53:17.599774 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 06:53:18.876848 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:53:18.883987 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:53:18.951182 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:53:18.977704 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:53:19.027678 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:53:19.094064 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:53:19.121487 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:53:19.672272 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 06:53:19.679324 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:19.692012 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:53:19.740149 tst handover.py: using LAC 39188 06:53:19.864353 tst handover.py: using RAC 173 06:53:19.986322 tst handover.py: using CellId 39188 06:53:20.110160 tst handover.py: using BVCI 39189 06:53:20.224307 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:53:20.270122 tst handover.py: using LAC 39189 06:53:20.392488 tst handover.py: using RAC 174 06:53:20.514755 tst handover.py: using CellId 39189 06:53:20.637222 tst handover.py: using BVCI 39190 06:53:20.754217 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:20.765372 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:20.776299 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:20.787240 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:20.798204 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:20.809130 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:53:20.925897 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:53:21.047628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:53:21.544223 run create_hlr_db(pid=19742): Launched 06:53:21.673939 bus /sierra_2: Setting Powered False 06:53:22.735877 run create_hlr_db(pid=19742): Terminated: ok {rc=0} 06:53:23.164718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19744): Launched 06:53:23.502589 run osmo-hlr_10.42.42.2(pid=19745): Launched 06:53:23.633428 run osmo-stp_10.42.42.5: Starting osmo-stp 06:53:24.181929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19747): Launched 06:53:24.518727 run osmo-stp_10.42.42.5(pid=19748): Launched 06:53:24.650036 run osmo-msc_10.42.42.6: Starting osmo-msc 06:53:25.225102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19750): Launched 06:53:25.563554 run osmo-msc_10.42.42.6(pid=19751): Launched 06:53:25.753566 run osmo-stp_10.42.42.5(pid=19748): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19748)] 06:53:25.894612 run osmo-stp_10.42.42.5(pid=19748): stdout: | (launched: 2022-12-14_06:53:24.456864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:26.036366 run osmo-stp_10.42.42.5(pid=19748): stderr: | 20221214065324653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065324653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065324653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065324653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065324654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065324654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065324654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:26.175459 run osmo-stp_10.42.42.5(pid=19748): stdout: | (launched: 2022-12-14_06:53:24.456864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:26.309289 run osmo-stp_10.42.42.5(pid=19748): stderr: | 20221214065324653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065324653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065324653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065324653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065324654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065324654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065324654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:26.469432 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19748): Process ended prematurely: osmo-stp_10.42.42.5(pid=19748) [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19748)] [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 06:53:26.478485 tst handover.py:18: Test FAILED (6.8 sec) 06:53:26.505916 run osmo-hlr_10.42.42.2(pid=19745): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19745)] 06:53:26.556208 run osmo-hlr_10.42.42.2(pid=19745): stdout: | (launched: 2022-12-14_06:53:23.440870) 06:53:26.607951 run osmo-hlr_10.42.42.2(pid=19745): stderr: | 20221214065323642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065323642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065323642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065323642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065323642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065323642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065323677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065323687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065323687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065323687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:53:26.680282 run osmo-msc_10.42.42.6(pid=19751): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19751)] 06:53:26.729830 run osmo-msc_10.42.42.6(pid=19751): stdout: | (launched: 2022-12-14_06:53:25.501767) 06:53:26.781135 run osmo-msc_10.42.42.6(pid=19751): stderr: | 20221214065325824 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065325824 DLGLOBAL DEBUG validating counter group 0x7f93ae22ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065325825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065325825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065325825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065325825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065325827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065325827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065325827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065325827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:53:26.832843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19744): Terminating (SIGTERM) 06:53:26.874455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19747): Terminating (SIGTERM) 06:53:26.916489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19750): Terminating (SIGTERM) 06:53:26.958473 --- ParallelTerminationStrategy: PID 19744 died... 06:53:26.978857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19744): Terminated: ok {rc=0} 06:53:27.025197 --- ParallelTerminationStrategy: PID 19747 died... 06:53:27.045335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19747): Terminated: ok {rc=0} 06:53:27.091312 --- ParallelTerminationStrategy: PID 19750 died... 06:53:27.111181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19750): Terminated: ok {rc=0} 06:53:27.198822 bus /sierra_3: Setting Powered False 06:53:28.295981 bus /sierra_3: Setting Powered False 06:53:29.411654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 06:53:30.687697 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:53:30.693911 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:53:30.747502 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:53:30.774711 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:53:30.835093 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:53:30.905354 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:53:30.933112 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:53:31.463090 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 06:53:31.470711 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:31.483261 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:53:31.521902 tst handover.py: using LAC 39190 06:53:31.697962 tst handover.py: using RAC 175 06:53:31.824295 tst handover.py: using CellId 39190 06:53:31.975886 tst handover.py: using BVCI 39191 06:53:32.134089 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:53:32.190186 tst handover.py: using LAC 39191 06:53:32.318156 tst handover.py: using RAC 176 06:53:32.443213 tst handover.py: using CellId 39191 06:53:32.577295 tst handover.py: using BVCI 39192 06:53:32.702444 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:32.713908 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:32.724916 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:32.736028 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:32.748196 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:53:32.760052 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:53:32.879774 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:53:33.000873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:53:33.494344 run create_hlr_db(pid=19756): Launched 06:53:33.623780 bus /sierra_2: Setting Powered False 06:53:34.689338 run create_hlr_db(pid=19756): Terminated: ok {rc=0} 06:53:35.111873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19758): Launched 06:53:35.429752 run osmo-hlr_10.42.42.2(pid=19759): Launched 06:53:35.550872 run osmo-stp_10.42.42.5: Starting osmo-stp 06:53:36.081722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19761): Launched 06:53:36.397669 run osmo-stp_10.42.42.5(pid=19762): Launched 06:53:36.517504 run osmo-msc_10.42.42.6: Starting osmo-msc 06:53:37.061754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19764): Launched 06:53:37.378452 run osmo-msc_10.42.42.6(pid=19765): Launched 06:53:37.556800 run osmo-stp_10.42.42.5(pid=19762): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19762)] 06:53:37.688917 run osmo-stp_10.42.42.5(pid=19762): stdout: | (launched: 2022-12-14_06:53:36.339379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:37.820460 run osmo-stp_10.42.42.5(pid=19762): stderr: | 20221214065336512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065336512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065336513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065336513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065336515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065336516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065336516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:37.950632 run osmo-stp_10.42.42.5(pid=19762): stdout: | (launched: 2022-12-14_06:53:36.339379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:38.075561 run osmo-stp_10.42.42.5(pid=19762): stderr: | 20221214065336512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065336512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065336513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065336513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065336515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065336516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065336516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:38.224560 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19762): Process ended prematurely: osmo-stp_10.42.42.5(pid=19762) [trial-2400↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19762)] [trial-2400↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 06:53:38.233124 tst handover.py:18: Test FAILED (6.8 sec) 06:53:38.259321 run osmo-hlr_10.42.42.2(pid=19759): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19759)] 06:53:38.307013 run osmo-hlr_10.42.42.2(pid=19759): stdout: | (launched: 2022-12-14_06:53:35.371540) 06:53:38.356085 run osmo-hlr_10.42.42.2(pid=19759): stderr: | 20221214065335550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065335550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065335550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065335550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065335550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065335550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065335562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065335570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065335570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065335570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:53:38.424868 run osmo-msc_10.42.42.6(pid=19765): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19765)] 06:53:38.472366 run osmo-msc_10.42.42.6(pid=19765): stdout: | (launched: 2022-12-14_06:53:37.320061) 06:53:38.521316 run osmo-msc_10.42.42.6(pid=19765): stderr: | 20221214065337593 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065337593 DLGLOBAL DEBUG validating counter group 0x7f5d1f689c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065337593 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065337593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065337593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065337594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065337595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065337596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065337596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065337596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:53:38.570768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19758): Terminating (SIGTERM) 06:53:38.610800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19761): Terminating (SIGTERM) 06:53:38.650961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19764): Terminating (SIGTERM) 06:53:38.691085 --- ParallelTerminationStrategy: PID 19758 died... 06:53:38.710449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19758): Terminated: ok {rc=0} 06:53:38.754627 --- ParallelTerminationStrategy: PID 19761 died... 06:53:38.773433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19761): Terminated: ok {rc=0} 06:53:38.817349 --- ParallelTerminationStrategy: PID 19764 died... 06:53:38.836105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19764): Terminated: ok {rc=0} 06:53:38.922043 bus /sierra_3: Setting Powered False 06:53:40.021142 bus /sierra_3: Setting Powered False 06:53:41.136803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 06:53:42.390963 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:53:42.396537 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:53:42.446071 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:53:42.472514 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:53:42.523520 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:53:42.573188 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:53:42.599459 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:53:43.150837 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 06:53:43.155962 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:43.166934 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:53:43.201070 tst handover.py: using LAC 39192 06:53:43.335028 tst handover.py: using RAC 177 06:53:43.468816 tst handover.py: using CellId 39192 06:53:43.594742 tst handover.py: using BVCI 39193 06:53:43.718183 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:53:43.768070 tst handover.py: using LAC 39193 06:53:43.894650 tst handover.py: using RAC 178 06:53:44.020911 tst handover.py: using CellId 39193 06:53:44.149750 tst handover.py: using BVCI 39194 06:53:44.266571 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:44.277522 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:44.288186 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:44.298861 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:44.310102 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:44.321468 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:53:44.443271 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:53:44.564246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:53:45.058810 run create_hlr_db(pid=19771): Launched 06:53:45.189381 bus /sierra_2: Setting Powered False 06:53:46.275961 run create_hlr_db(pid=19771): Terminated: ok {rc=0} 06:53:46.790153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19773): Launched 06:53:47.121137 run osmo-hlr_10.42.42.2(pid=19776): Launched 06:53:47.312003 run osmo-stp_10.42.42.5: Starting osmo-stp 06:53:47.864476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19778): Launched 06:53:48.201320 run osmo-stp_10.42.42.5(pid=19779): Launched 06:53:48.329698 run osmo-msc_10.42.42.6: Starting osmo-msc 06:53:48.909991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19781): Launched 06:53:49.248496 run osmo-msc_10.42.42.6(pid=19782): Launched 06:53:49.438988 run osmo-stp_10.42.42.5(pid=19779): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19779)] 06:53:49.581096 run osmo-stp_10.42.42.5(pid=19779): stdout: | (launched: 2022-12-14_06:53:48.139461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:49.723417 run osmo-stp_10.42.42.5(pid=19779): stderr: | 20221214065348337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065348337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065348337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065348337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065348338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065348338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065348338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:49.863458 run osmo-stp_10.42.42.5(pid=19779): stdout: | (launched: 2022-12-14_06:53:48.139461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:53:49.997382 run osmo-stp_10.42.42.5(pid=19779): stderr: | 20221214065348337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065348337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065348337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065348337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065348338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065348338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065348338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:53:50.157432 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19779): Process ended prematurely: osmo-stp_10.42.42.5(pid=19779) [trial-2400↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19779)] [trial-2400↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 06:53:50.166506 tst handover.py:18: Test FAILED (7.0 sec) 06:53:50.194103 run osmo-hlr_10.42.42.2(pid=19776): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19776)] 06:53:50.245114 run osmo-hlr_10.42.42.2(pid=19776): stdout: | (launched: 2022-12-14_06:53:47.060650) 06:53:50.297770 run osmo-hlr_10.42.42.2(pid=19776): stderr: | 20221214065347323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065347323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065347323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065347323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065347323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065347323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065347334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065347342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065347343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065347343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:53:50.371248 run osmo-msc_10.42.42.6(pid=19782): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19782)] 06:53:50.421524 run osmo-msc_10.42.42.6(pid=19782): stdout: | (launched: 2022-12-14_06:53:49.186634) 06:53:50.474011 run osmo-msc_10.42.42.6(pid=19782): stderr: | 20221214065349510 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065349511 DLGLOBAL DEBUG validating counter group 0x7fc63cdc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065349511 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065349511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065349511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065349511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065349513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065349513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065349513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065349513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:53:50.526660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19773): Terminating (SIGTERM) 06:53:50.568896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19778): Terminating (SIGTERM) 06:53:50.611334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19781): Terminating (SIGTERM) 06:53:50.654155 --- ParallelTerminationStrategy: PID 19773 died... 06:53:50.674552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19773): Terminated: ok {rc=0} 06:53:50.721470 --- ParallelTerminationStrategy: PID 19778 died... 06:53:50.741553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19778): Terminated: ok {rc=0} 06:53:50.788353 --- ParallelTerminationStrategy: PID 19781 died... 06:53:50.808356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19781): Terminated: ok {rc=0} 06:53:50.897452 bus /sierra_3: Setting Powered False 06:53:51.996758 bus /sierra_3: Setting Powered False 06:53:53.115472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2400 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 06:53:54.377441 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:53:54.383469 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:53:54.447072 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:53:54.474684 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:53:54.527696 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:53:54.591661 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:53:54.618817 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:53:55.170730 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2400 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 06:53:55.176171 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:55.187476 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:53:55.235818 tst handover.py: using LAC 39194 06:53:55.364892 tst handover.py: using RAC 179 06:53:55.489718 tst handover.py: using CellId 39194 06:53:55.614071 tst handover.py: using BVCI 39195 06:53:55.729061 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:53:55.775609 tst handover.py: using LAC 39195 06:53:55.898676 tst handover.py: using RAC 180 06:53:56.023133 tst handover.py: using CellId 39195 06:53:56.151051 tst handover.py: using BVCI 39196 06:53:56.267643 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:56.278738 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:56.289484 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:56.300203 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:56.311629 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:53:56.323067 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:53:56.443644 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:53:56.565301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:53:57.060362 run create_hlr_db(pid=19787): Launched 06:53:57.191176 bus /sierra_2: Setting Powered False 06:53:58.257426 run create_hlr_db(pid=19787): Terminated: ok {rc=0} 06:53:58.696925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19789): Launched 06:53:59.036475 run osmo-hlr_10.42.42.2(pid=19790): Launched 06:53:59.165853 run osmo-stp_10.42.42.5: Starting osmo-stp 06:53:59.721580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19792): Launched 06:54:00.057484 run osmo-stp_10.42.42.5(pid=19793): Launched 06:54:00.187648 run osmo-msc_10.42.42.6: Starting osmo-msc 06:54:00.768654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19795): Launched 06:54:01.125745 run osmo-msc_10.42.42.6(pid=19796): Launched 06:54:01.565962 run osmo-stp_10.42.42.5(pid=19793): ERR: Terminated: ERROR {rc=1} [trial-2400↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19793)] 06:54:01.958648 run osmo-stp_10.42.42.5(pid=19793): stdout: | (launched: 2022-12-14_06:53:59.995470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:54:02.180816 run osmo-stp_10.42.42.5(pid=19793): stderr: | 20221214065400189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065400189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065400189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065400190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065400192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065400192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065400192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:54:02.345847 run osmo-stp_10.42.42.5(pid=19793): stdout: | (launched: 2022-12-14_06:53:59.995470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:54:02.511061 run osmo-stp_10.42.42.5(pid=19793): stderr: | 20221214065400189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065400189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065400189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065400190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065400192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065400192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065400192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:54:02.697684 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19793): Process ended prematurely: osmo-stp_10.42.42.5(pid=19793) [trial-2400↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19793)] [trial-2400↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 06:54:02.711147 tst handover.py:18: Test FAILED (7.5 sec) 06:54:02.745887 run osmo-hlr_10.42.42.2(pid=19790): ERR: Terminated: ERROR {rc=237} [trial-2400↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19790)] 06:54:02.809229 run osmo-hlr_10.42.42.2(pid=19790): stdout: | (launched: 2022-12-14_06:53:58.974066) 06:54:02.872098 run osmo-hlr_10.42.42.2(pid=19790): stderr: | 20221214065359175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065359175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065359176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065359176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065359176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065359176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065359188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065359197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065359197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065359197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:54:02.969413 run osmo-msc_10.42.42.6(pid=19796): ERR: Terminated: ERROR {rc=2} [trial-2400↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19796)] 06:54:03.037465 run osmo-msc_10.42.42.6(pid=19796): stdout: | (launched: 2022-12-14_06:54:01.059809) 06:54:03.106369 run osmo-msc_10.42.42.6(pid=19796): stderr: | 20221214065401513 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065401513 DLGLOBAL DEBUG validating counter group 0x7f428958cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065401513 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065401513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065401513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065401513 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065401515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065401515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065401516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065401516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:54:03.181873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19789): Terminating (SIGTERM) 06:54:03.237571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19792): Terminating (SIGTERM) 06:54:03.294476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19795): Terminating (SIGTERM) 06:54:03.345959 --- ParallelTerminationStrategy: PID 19789 died... 06:54:03.368656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19789): Terminated: ok {rc=0} 06:54:03.422941 --- ParallelTerminationStrategy: PID 19792 died... 06:54:03.446743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19792): Terminated: ok {rc=0} 06:54:03.511651 --- ParallelTerminationStrategy: PID 19795 died... 06:54:03.535986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19795): Terminated: ok {rc=0} 06:54:03.646182 bus /sierra_3: Setting Powered False 06:54:04.758853 bus /sierra_3: Setting Powered False 06:54:05.873902 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2400 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 06:54:07.153699 tst trial-2400: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/trial-2400.xml -------------------------------------------------------------------------------------------- trial-2400 FAIL -------------------------------------------------------------------------------------------- 06:54:09.116842 tst trial-2400: trial-2400: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=12069): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12069) [trial-2400↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12069)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=12083): Process ended prematurely: osmo-stp_10.42.42.5(pid=12083) [trial-2400↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12083)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12092) [trial-2400↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12092)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12102): Process ended prematurely: osmo-stp_10.42.42.5(pid=12102) [trial-2400↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12102)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12116): Process ended prematurely: osmo-stp_10.42.42.5(pid=12116) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12116)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12127): Process ended prematurely: osmo-stp_10.42.42.5(pid=12127) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12127)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12141): Process ended prematurely: osmo-stp_10.42.42.5(pid=12141) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12141)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12152): Process ended prematurely: osmo-stp_10.42.42.5(pid=12152) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12152)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12166): Process ended prematurely: osmo-stp_10.42.42.5(pid=12166) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12166)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12177): Process ended prematurely: osmo-stp_10.42.42.5(pid=12177) [trial-2400↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12177)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12191): Process ended prematurely: osmo-stp_10.42.42.5(pid=12191) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12216): Process ended prematurely: osmo-stp_10.42.42.5(pid=12216) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12216)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12228): Process ended prematurely: osmo-stp_10.42.42.5(pid=12228) [trial-2400↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12228)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12242): Process ended prematurely: osmo-stp_10.42.42.5(pid=12242) [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12242)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12253): Process ended prematurely: osmo-stp_10.42.42.5(pid=12253) [trial-2400↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12253)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12267): Process ended prematurely: osmo-stp_10.42.42.5(pid=12267) [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12267)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12278): Process ended prematurely: osmo-stp_10.42.42.5(pid=12278) [trial-2400↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12278)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12295): Process ended prematurely: osmo-stp_10.42.42.5(pid=12295) [trial-2400↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12295)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12306): Process ended prematurely: osmo-stp_10.42.42.5(pid=12306) [trial-2400↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12306)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=12324): Process ended prematurely: osmo-stp_10.42.42.5(pid=12324) [trial-2400↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12324)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12336): Process ended prematurely: osmo-stp_10.42.42.5(pid=12336) [trial-2400↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12336)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12354): Process ended prematurely: osmo-stp_10.42.42.5(pid=12354) [trial-2400↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12354)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12367): Process ended prematurely: osmo-stp_10.42.42.5(pid=12367) [trial-2400↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12367)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12377): Process ended prematurely: osmo-stp_10.42.42.5(pid=12377) [trial-2400↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12377)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12394): Process ended prematurely: osmo-stp_10.42.42.5(pid=12394) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12394)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12406): Process ended prematurely: osmo-stp_10.42.42.5(pid=12406) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12406)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12445): Process ended prematurely: osmo-stp_10.42.42.5(pid=12445) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12445)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12455): Process ended prematurely: osmo-stp_10.42.42.5(pid=12455) [trial-2400↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12455)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12472): Process ended prematurely: osmo-stp_10.42.42.5(pid=12472) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12472)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12484): Process ended prematurely: osmo-stp_10.42.42.5(pid=12484) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12484)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=12502): Process ended prematurely: osmo-stp_10.42.42.5(pid=12502) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12512): Process ended prematurely: osmo-stp_10.42.42.5(pid=12512) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12512)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12522): Process ended prematurely: osmo-stp_10.42.42.5(pid=12522) [trial-2400↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12522)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12540): Process ended prematurely: osmo-stp_10.42.42.5(pid=12540) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12540)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=12552): Process ended prematurely: osmo-stp_10.42.42.5(pid=12552) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12552)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=12571): Process ended prematurely: osmo-stp_10.42.42.5(pid=12571) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12571)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12581): Process ended prematurely: osmo-stp_10.42.42.5(pid=12581) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12581)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=12591): Process ended prematurely: osmo-stp_10.42.42.5(pid=12591) [trial-2400↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2400↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12618): Process ended prematurely: osmo-stp_10.42.42.5(pid=12618) [trial-2400↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12618)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=12626): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12626) [trial-2400↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12626)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12636): Process ended prematurely: osmo-stp_10.42.42.5(pid=12636) [trial-2400↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12636)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12916): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12916) [trial-2400↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12916)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=12933): Process ended prematurely: osmo-stp_10.42.42.5(pid=12933) [trial-2400↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12933)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12948): Process ended prematurely: osmo-stp_10.42.42.5(pid=12948) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12948)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12959): Process ended prematurely: osmo-stp_10.42.42.5(pid=12959) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12959)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12973): Process ended prematurely: osmo-stp_10.42.42.5(pid=12973) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12973)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12984): Process ended prematurely: osmo-stp_10.42.42.5(pid=12984) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12984)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13001): Process ended prematurely: osmo-stp_10.42.42.5(pid=13001) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13001)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13012): Process ended prematurely: osmo-stp_10.42.42.5(pid=13012) [trial-2400↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13012)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13026): Process ended prematurely: osmo-stp_10.42.42.5(pid=13026) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13026)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13037): Process ended prematurely: osmo-stp_10.42.42.5(pid=13037) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13037)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13052): Process ended prematurely: osmo-stp_10.42.42.5(pid=13052) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13052)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13063): Process ended prematurely: osmo-stp_10.42.42.5(pid=13063) [trial-2400↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13063)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13077): Process ended prematurely: osmo-stp_10.42.42.5(pid=13077) [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13077)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13089): Process ended prematurely: osmo-stp_10.42.42.5(pid=13089) [trial-2400↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13089)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13103): Process ended prematurely: osmo-stp_10.42.42.5(pid=13103) [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13103)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13114): Process ended prematurely: osmo-stp_10.42.42.5(pid=13114) [trial-2400↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13114)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13128): Process ended prematurely: osmo-stp_10.42.42.5(pid=13128) [trial-2400↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13128)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13148): Process ended prematurely: osmo-stp_10.42.42.5(pid=13148) [trial-2400↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13148)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=13166): Process ended prematurely: osmo-stp_10.42.42.5(pid=13166) [trial-2400↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13166)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13178): Process ended prematurely: osmo-stp_10.42.42.5(pid=13178) [trial-2400↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13178)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13196): Process ended prematurely: osmo-stp_10.42.42.5(pid=13196) [trial-2400↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13196)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13206): Process ended prematurely: osmo-stp_10.42.42.5(pid=13206) [trial-2400↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13206)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=13216): Process ended prematurely: osmo-stp_10.42.42.5(pid=13216) [trial-2400↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13216)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13235): Process ended prematurely: osmo-stp_10.42.42.5(pid=13235) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13235)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13247): Process ended prematurely: osmo-stp_10.42.42.5(pid=13247) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13247)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=13265): Process ended prematurely: osmo-stp_10.42.42.5(pid=13265) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13265)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13275): Process ended prematurely: osmo-stp_10.42.42.5(pid=13275) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13275)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=13285): Process ended prematurely: osmo-stp_10.42.42.5(pid=13285) [trial-2400↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=13303): Process ended prematurely: osmo-stp_10.42.42.5(pid=13303) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13303)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13315): Process ended prematurely: osmo-stp_10.42.42.5(pid=13315) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13315)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=13333): Process ended prematurely: osmo-stp_10.42.42.5(pid=13333) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13333)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13354): Process ended prematurely: osmo-stp_10.42.42.5(pid=13354) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13354)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13715): Process ended prematurely: osmo-stp_10.42.42.5(pid=13715) [trial-2400↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=13910): Process ended prematurely: osmo-stp_10.42.42.5(pid=13910) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13910)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=13922): Process ended prematurely: osmo-stp_10.42.42.5(pid=13922) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13922)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13946): Process ended prematurely: osmo-stp_10.42.42.5(pid=13946) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13946)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13956): Process ended prematurely: osmo-stp_10.42.42.5(pid=13956) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13956)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13966): Process ended prematurely: osmo-stp_10.42.42.5(pid=13966) [trial-2400↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13966)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13980): Process ended prematurely: osmo-stp_10.42.42.5(pid=13980) [trial-2400↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13980)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13993): Process ended prematurely: osmo-stp_10.42.42.5(pid=13993) [trial-2400↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13993)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14001) [trial-2400↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14001)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14011): Process ended prematurely: osmo-stp_10.42.42.5(pid=14011) [trial-2400↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14011)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=14020): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14020) [trial-2400↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14020)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14030): Process ended prematurely: osmo-stp_10.42.42.5(pid=14030) [trial-2400↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14030)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14044): Process ended prematurely: osmo-stp_10.42.42.5(pid=14044) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14044)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14055): Process ended prematurely: osmo-stp_10.42.42.5(pid=14055) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14055)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14070): Process ended prematurely: osmo-stp_10.42.42.5(pid=14070) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14070)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14081): Process ended prematurely: osmo-stp_10.42.42.5(pid=14081) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14081)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14095): Process ended prematurely: osmo-stp_10.42.42.5(pid=14095) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14095)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14106): Process ended prematurely: osmo-stp_10.42.42.5(pid=14106) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14106)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14120): Process ended prematurely: osmo-stp_10.42.42.5(pid=14120) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14120)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14131): Process ended prematurely: osmo-stp_10.42.42.5(pid=14131) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14131)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14145): Process ended prematurely: osmo-stp_10.42.42.5(pid=14145) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14145)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14156): Process ended prematurely: osmo-stp_10.42.42.5(pid=14156) [trial-2400↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14156)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14171): Process ended prematurely: osmo-stp_10.42.42.5(pid=14171) [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14171)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14182): Process ended prematurely: osmo-stp_10.42.42.5(pid=14182) [trial-2400↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14182)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14196): Process ended prematurely: osmo-stp_10.42.42.5(pid=14196) [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14196)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14207): Process ended prematurely: osmo-stp_10.42.42.5(pid=14207) [trial-2400↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14207)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14221): Process ended prematurely: osmo-stp_10.42.42.5(pid=14221) [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14221)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14235): Process ended prematurely: osmo-stp_10.42.42.5(pid=14235) [trial-2400↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14235)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14250): Process ended prematurely: osmo-stp_10.42.42.5(pid=14250) [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14250)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14261): Process ended prematurely: osmo-stp_10.42.42.5(pid=14261) [trial-2400↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14261)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14275): Process ended prematurely: osmo-stp_10.42.42.5(pid=14275) [trial-2400↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14275)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14286): Process ended prematurely: osmo-stp_10.42.42.5(pid=14286) [trial-2400↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14286)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14305): Process ended prematurely: osmo-stp_10.42.42.5(pid=14305) [trial-2400↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14305)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14317): Process ended prematurely: osmo-stp_10.42.42.5(pid=14317) [trial-2400↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14317)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14335): Process ended prematurely: osmo-stp_10.42.42.5(pid=14335) [trial-2400↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14346): Process ended prematurely: osmo-stp_10.42.42.5(pid=14346) [trial-2400↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14346)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14356): Process ended prematurely: osmo-stp_10.42.42.5(pid=14356) [trial-2400↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14356)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=14373): Process ended prematurely: osmo-stp_10.42.42.5(pid=14373) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14373)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14385): Process ended prematurely: osmo-stp_10.42.42.5(pid=14385) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14385)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14403): Process ended prematurely: osmo-stp_10.42.42.5(pid=14403) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14403)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14413): Process ended prematurely: osmo-stp_10.42.42.5(pid=14413) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14413)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14423): Process ended prematurely: osmo-stp_10.42.42.5(pid=14423) [trial-2400↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14423)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14441): Process ended prematurely: osmo-stp_10.42.42.5(pid=14441) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14441)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=14453): Process ended prematurely: osmo-stp_10.42.42.5(pid=14453) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14453)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=14472): Process ended prematurely: osmo-stp_10.42.42.5(pid=14472) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14472)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14482): Process ended prematurely: osmo-stp_10.42.42.5(pid=14482) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14482)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14492): Process ended prematurely: osmo-stp_10.42.42.5(pid=14492) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14492)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=14781): Process ended prematurely: osmo-stp_10.42.42.5(pid=14781) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14793): Process ended prematurely: osmo-stp_10.42.42.5(pid=14793) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14793)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14811): Process ended prematurely: osmo-stp_10.42.42.5(pid=14811) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14811)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14821): Process ended prematurely: osmo-stp_10.42.42.5(pid=14821) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14821)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=14831): Process ended prematurely: osmo-stp_10.42.42.5(pid=14831) [trial-2400↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14831)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14852): Process ended prematurely: osmo-stp_10.42.42.5(pid=14852) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14852)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=14864): Process ended prematurely: osmo-stp_10.42.42.5(pid=14864) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14864)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14882): Process ended prematurely: osmo-stp_10.42.42.5(pid=14882) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14882)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14894): Process ended prematurely: osmo-stp_10.42.42.5(pid=14894) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14894)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=14904): Process ended prematurely: osmo-stp_10.42.42.5(pid=14904) [trial-2400↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14904)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14918): Process ended prematurely: osmo-stp_10.42.42.5(pid=14918) [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14918)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14931): Process ended prematurely: osmo-stp_10.42.42.5(pid=14931) [trial-2400↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14931)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=14939): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14939) [trial-2400↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14939)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14949): Process ended prematurely: osmo-stp_10.42.42.5(pid=14949) [trial-2400↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14949)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14959): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14959) [trial-2400↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14959)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14969): Process ended prematurely: osmo-stp_10.42.42.5(pid=14969) [trial-2400↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14969)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14983): Process ended prematurely: osmo-stp_10.42.42.5(pid=14983) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14983)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14994): Process ended prematurely: osmo-stp_10.42.42.5(pid=14994) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14994)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15009): Process ended prematurely: osmo-stp_10.42.42.5(pid=15009) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15009)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15020): Process ended prematurely: osmo-stp_10.42.42.5(pid=15020) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15020)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15034): Process ended prematurely: osmo-stp_10.42.42.5(pid=15034) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15034)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15045): Process ended prematurely: osmo-stp_10.42.42.5(pid=15045) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15045)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15060): Process ended prematurely: osmo-stp_10.42.42.5(pid=15060) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15060)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15071): Process ended prematurely: osmo-stp_10.42.42.5(pid=15071) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15071)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15085): Process ended prematurely: osmo-stp_10.42.42.5(pid=15085) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15085)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15096): Process ended prematurely: osmo-stp_10.42.42.5(pid=15096) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15096)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15111): Process ended prematurely: osmo-stp_10.42.42.5(pid=15111) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15111)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15122): Process ended prematurely: osmo-stp_10.42.42.5(pid=15122) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15122)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15136): Process ended prematurely: osmo-stp_10.42.42.5(pid=15136) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15136)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15147): Process ended prematurely: osmo-stp_10.42.42.5(pid=15147) [trial-2400↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15147)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15161): Process ended prematurely: osmo-stp_10.42.42.5(pid=15161) [trial-2400↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15161)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15172): Process ended prematurely: osmo-stp_10.42.42.5(pid=15172) [trial-2400↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15172)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15221): Process ended prematurely: osmo-stp_10.42.42.5(pid=15221) [trial-2400↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15221)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=15234): Process ended prematurely: osmo-stp_10.42.42.5(pid=15234) [trial-2400↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15234)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=15252): Process ended prematurely: osmo-stp_10.42.42.5(pid=15252) [trial-2400↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15252)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15262): Process ended prematurely: osmo-stp_10.42.42.5(pid=15262) [trial-2400↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15262)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15272): Process ended prematurely: osmo-stp_10.42.42.5(pid=15272) [trial-2400↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15272)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15289): Process ended prematurely: osmo-stp_10.42.42.5(pid=15289) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15289)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15301): Process ended prematurely: osmo-stp_10.42.42.5(pid=15301) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15301)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=15319): Process ended prematurely: osmo-stp_10.42.42.5(pid=15319) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15329): Process ended prematurely: osmo-stp_10.42.42.5(pid=15329) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15339): Process ended prematurely: osmo-stp_10.42.42.5(pid=15339) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15339)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15359): Process ended prematurely: osmo-stp_10.42.42.5(pid=15359) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15359)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15371): Process ended prematurely: osmo-stp_10.42.42.5(pid=15371) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15371)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15389): Process ended prematurely: osmo-stp_10.42.42.5(pid=15389) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15389)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15399): Process ended prematurely: osmo-stp_10.42.42.5(pid=15399) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15399)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15409): Process ended prematurely: osmo-stp_10.42.42.5(pid=15409) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15409)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=15428): Process ended prematurely: osmo-stp_10.42.42.5(pid=15428) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15428)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=15440): Process ended prematurely: osmo-stp_10.42.42.5(pid=15440) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15440)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15458): Process ended prematurely: osmo-stp_10.42.42.5(pid=15458) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15458)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15468): Process ended prematurely: osmo-stp_10.42.42.5(pid=15468) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15468)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15478): Process ended prematurely: osmo-stp_10.42.42.5(pid=15478) [trial-2400↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15478)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15493): Process ended prematurely: osmo-stp_10.42.42.5(pid=15493) [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15493)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15506): Process ended prematurely: osmo-stp_10.42.42.5(pid=15506) [trial-2400↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15514) [trial-2400↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15514)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15524): Process ended prematurely: osmo-stp_10.42.42.5(pid=15524) [trial-2400↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15524)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15533) [trial-2400↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15533)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15544): Process ended prematurely: osmo-stp_10.42.42.5(pid=15544) [trial-2400↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15544)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15561): Process ended prematurely: osmo-stp_10.42.42.5(pid=15561) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15561)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15572): Process ended prematurely: osmo-stp_10.42.42.5(pid=15572) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15572)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15586): Process ended prematurely: osmo-stp_10.42.42.5(pid=15586) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15586)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15597): Process ended prematurely: osmo-stp_10.42.42.5(pid=15597) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15597)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15611): Process ended prematurely: osmo-stp_10.42.42.5(pid=15611) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15611)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15626): Process ended prematurely: osmo-stp_10.42.42.5(pid=15626) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15640): Process ended prematurely: osmo-stp_10.42.42.5(pid=15640) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15640)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15651): Process ended prematurely: osmo-stp_10.42.42.5(pid=15651) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15651)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15665): Process ended prematurely: osmo-stp_10.42.42.5(pid=15665) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15665)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15676): Process ended prematurely: osmo-stp_10.42.42.5(pid=15676) [trial-2400↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15676)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15690): Process ended prematurely: osmo-stp_10.42.42.5(pid=15690) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15690)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15701): Process ended prematurely: osmo-stp_10.42.42.5(pid=15701) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15701)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15716): Process ended prematurely: osmo-stp_10.42.42.5(pid=15716) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15716)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15727): Process ended prematurely: osmo-stp_10.42.42.5(pid=15727) [trial-2400↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15727)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15741): Process ended prematurely: osmo-stp_10.42.42.5(pid=15741) [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15741)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15752): Process ended prematurely: osmo-stp_10.42.42.5(pid=15752) [trial-2400↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15752)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15766): Process ended prematurely: osmo-stp_10.42.42.5(pid=15766) [trial-2400↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15766)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15777): Process ended prematurely: osmo-stp_10.42.42.5(pid=15777) [trial-2400↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15777)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=15795): Process ended prematurely: osmo-stp_10.42.42.5(pid=15795) [trial-2400↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15795)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15807): Process ended prematurely: osmo-stp_10.42.42.5(pid=15807) [trial-2400↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15807)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=15825): Process ended prematurely: osmo-stp_10.42.42.5(pid=15825) [trial-2400↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15825)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=16107): Process ended prematurely: osmo-stp_10.42.42.5(pid=16107) [trial-2400↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16107)] FAIL: ping_idle_ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16117): Process ended prematurely: osmo-stp_10.42.42.5(pid=16117) [trial-2400↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16117)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=16137): Process ended prematurely: osmo-stp_10.42.42.5(pid=16137) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16137)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=16149): Process ended prematurely: osmo-stp_10.42.42.5(pid=16149) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16149)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=16167): Process ended prematurely: osmo-stp_10.42.42.5(pid=16167) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16167)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16180): Process ended prematurely: osmo-stp_10.42.42.5(pid=16180) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16180)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16190): Process ended prematurely: osmo-stp_10.42.42.5(pid=16190) [trial-2400↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16190)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16208): Process ended prematurely: osmo-stp_10.42.42.5(pid=16208) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16208)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=16220): Process ended prematurely: osmo-stp_10.42.42.5(pid=16220) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16220)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=16241): Process ended prematurely: osmo-stp_10.42.42.5(pid=16241) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16241)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16251): Process ended prematurely: osmo-stp_10.42.42.5(pid=16251) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16251)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16261): Process ended prematurely: osmo-stp_10.42.42.5(pid=16261) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16261)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16278): Process ended prematurely: osmo-stp_10.42.42.5(pid=16278) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16278)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=16290): Process ended prematurely: osmo-stp_10.42.42.5(pid=16290) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16290)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=16308): Process ended prematurely: osmo-stp_10.42.42.5(pid=16308) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16308)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16318): Process ended prematurely: osmo-stp_10.42.42.5(pid=16318) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16318)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16328): Process ended prematurely: osmo-stp_10.42.42.5(pid=16328) [trial-2400↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16328)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16347): Process ended prematurely: osmo-stp_10.42.42.5(pid=16347) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16347)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=16359): Process ended prematurely: osmo-stp_10.42.42.5(pid=16359) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16359)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=16377): Process ended prematurely: osmo-stp_10.42.42.5(pid=16377) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16377)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16387): Process ended prematurely: osmo-stp_10.42.42.5(pid=16387) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16397): Process ended prematurely: osmo-stp_10.42.42.5(pid=16397) [trial-2400↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16397)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16410): Process ended prematurely: osmo-stp_10.42.42.5(pid=16410) [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16410)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16425): Process ended prematurely: osmo-stp_10.42.42.5(pid=16425) [trial-2400↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16425)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=16433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16433) [trial-2400↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16433)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16443): Process ended prematurely: osmo-stp_10.42.42.5(pid=16443) [trial-2400↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16443)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16453): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16453) [trial-2400↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16453)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16463): Process ended prematurely: osmo-stp_10.42.42.5(pid=16463) [trial-2400↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16463)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16477): Process ended prematurely: osmo-stp_10.42.42.5(pid=16477) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16477)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16488): Process ended prematurely: osmo-stp_10.42.42.5(pid=16488) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16488)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16503): Process ended prematurely: osmo-stp_10.42.42.5(pid=16503) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16503)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16517): Process ended prematurely: osmo-stp_10.42.42.5(pid=16517) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16532): Process ended prematurely: osmo-stp_10.42.42.5(pid=16532) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16532)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16543): Process ended prematurely: osmo-stp_10.42.42.5(pid=16543) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16543)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16557): Process ended prematurely: osmo-stp_10.42.42.5(pid=16557) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16557)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16568): Process ended prematurely: osmo-stp_10.42.42.5(pid=16568) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16568)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16582): Process ended prematurely: osmo-stp_10.42.42.5(pid=16582) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16582)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16593): Process ended prematurely: osmo-stp_10.42.42.5(pid=16593) [trial-2400↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16593)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16607): Process ended prematurely: osmo-stp_10.42.42.5(pid=16607) [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16607)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16618): Process ended prematurely: osmo-stp_10.42.42.5(pid=16618) [trial-2400↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16618)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16632): Process ended prematurely: osmo-stp_10.42.42.5(pid=16632) [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16632)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16643): Process ended prematurely: osmo-stp_10.42.42.5(pid=16643) [trial-2400↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16643)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16663): Process ended prematurely: osmo-stp_10.42.42.5(pid=16663) [trial-2400↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16663)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16674): Process ended prematurely: osmo-stp_10.42.42.5(pid=16674) [trial-2400↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16674)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=16692): Process ended prematurely: osmo-stp_10.42.42.5(pid=16692) [trial-2400↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16692)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=16704): Process ended prematurely: osmo-stp_10.42.42.5(pid=16704) [trial-2400↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16704)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=16722): Process ended prematurely: osmo-stp_10.42.42.5(pid=16722) [trial-2400↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16722)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16732): Process ended prematurely: osmo-stp_10.42.42.5(pid=16732) [trial-2400↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16732)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16742): Process ended prematurely: osmo-stp_10.42.42.5(pid=16742) [trial-2400↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16742)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16759): Process ended prematurely: osmo-stp_10.42.42.5(pid=16759) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16759)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=16771): Process ended prematurely: osmo-stp_10.42.42.5(pid=16771) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16771)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=16789): Process ended prematurely: osmo-stp_10.42.42.5(pid=16789) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16789)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16801): Process ended prematurely: osmo-stp_10.42.42.5(pid=16801) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16801)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16811): Process ended prematurely: osmo-stp_10.42.42.5(pid=16811) [trial-2400↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16811)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=16829): Process ended prematurely: osmo-stp_10.42.42.5(pid=16829) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16829)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=16841): Process ended prematurely: osmo-stp_10.42.42.5(pid=16841) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16841)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=16860): Process ended prematurely: osmo-stp_10.42.42.5(pid=16860) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16860)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16874): Process ended prematurely: osmo-stp_10.42.42.5(pid=16874) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16874)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16884): Process ended prematurely: osmo-stp_10.42.42.5(pid=16884) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16884)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16902): Process ended prematurely: osmo-stp_10.42.42.5(pid=16902) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16902)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16914): Process ended prematurely: osmo-stp_10.42.42.5(pid=16914) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16914)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=16932): Process ended prematurely: osmo-stp_10.42.42.5(pid=16932) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16932)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16942): Process ended prematurely: osmo-stp_10.42.42.5(pid=16942) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16942)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16952): Process ended prematurely: osmo-stp_10.42.42.5(pid=16952) [trial-2400↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16952)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16965): Process ended prematurely: osmo-stp_10.42.42.5(pid=16965) [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16965)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16978): Process ended prematurely: osmo-stp_10.42.42.5(pid=16978) [trial-2400↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16978)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=16986): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16986) [trial-2400↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16986)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16996): Process ended prematurely: osmo-stp_10.42.42.5(pid=16996) [trial-2400↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16996)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17005): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17005) [trial-2400↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17005)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=17015): Process ended prematurely: osmo-stp_10.42.42.5(pid=17015) [trial-2400↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17029): Process ended prematurely: osmo-stp_10.42.42.5(pid=17029) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17040): Process ended prematurely: osmo-stp_10.42.42.5(pid=17040) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17054): Process ended prematurely: osmo-stp_10.42.42.5(pid=17054) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17054)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17065): Process ended prematurely: osmo-stp_10.42.42.5(pid=17065) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17065)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17080): Process ended prematurely: osmo-stp_10.42.42.5(pid=17080) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17080)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17091): Process ended prematurely: osmo-stp_10.42.42.5(pid=17091) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17091)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17105): Process ended prematurely: osmo-stp_10.42.42.5(pid=17105) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17105)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17116): Process ended prematurely: osmo-stp_10.42.42.5(pid=17116) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17116)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17132): Process ended prematurely: osmo-stp_10.42.42.5(pid=17132) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17132)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17414): Process ended prematurely: osmo-stp_10.42.42.5(pid=17414) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17414)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=17428): Process ended prematurely: osmo-stp_10.42.42.5(pid=17428) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17428)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17440): Process ended prematurely: osmo-stp_10.42.42.5(pid=17440) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17440)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17454): Process ended prematurely: osmo-stp_10.42.42.5(pid=17454) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17454)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17465): Process ended prematurely: osmo-stp_10.42.42.5(pid=17465) [trial-2400↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17465)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17483): Process ended prematurely: osmo-stp_10.42.42.5(pid=17483) [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17483)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17494): Process ended prematurely: osmo-stp_10.42.42.5(pid=17494) [trial-2400↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17494)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17512): Process ended prematurely: osmo-stp_10.42.42.5(pid=17512) [trial-2400↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17512)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=17524): Process ended prematurely: osmo-stp_10.42.42.5(pid=17524) [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17524)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=17592): Process ended prematurely: osmo-stp_10.42.42.5(pid=17592) [trial-2400↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17592)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17602): Process ended prematurely: osmo-stp_10.42.42.5(pid=17602) [trial-2400↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17612): Process ended prematurely: osmo-stp_10.42.42.5(pid=17612) [trial-2400↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17612)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17629): Process ended prematurely: osmo-stp_10.42.42.5(pid=17629) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17629)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17641): Process ended prematurely: osmo-stp_10.42.42.5(pid=17641) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17641)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=17659): Process ended prematurely: osmo-stp_10.42.42.5(pid=17659) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17659)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17671): Process ended prematurely: osmo-stp_10.42.42.5(pid=17671) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17671)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17681): Process ended prematurely: osmo-stp_10.42.42.5(pid=17681) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17681)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=17698): Process ended prematurely: osmo-stp_10.42.42.5(pid=17698) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17698)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17710): Process ended prematurely: osmo-stp_10.42.42.5(pid=17710) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17710)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=17728): Process ended prematurely: osmo-stp_10.42.42.5(pid=17728) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17728)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17738): Process ended prematurely: osmo-stp_10.42.42.5(pid=17738) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17738)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17748): Process ended prematurely: osmo-stp_10.42.42.5(pid=17748) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17748)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=17767): Process ended prematurely: osmo-stp_10.42.42.5(pid=17767) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17767)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=17779): Process ended prematurely: osmo-stp_10.42.42.5(pid=17779) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=17797): Process ended prematurely: osmo-stp_10.42.42.5(pid=17797) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17797)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17807): Process ended prematurely: osmo-stp_10.42.42.5(pid=17807) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17807)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17817): Process ended prematurely: osmo-stp_10.42.42.5(pid=17817) [trial-2400↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17817)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17831): Process ended prematurely: osmo-stp_10.42.42.5(pid=17831) [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17831)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17844): Process ended prematurely: osmo-stp_10.42.42.5(pid=17844) [trial-2400↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17844)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=17852): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17852) [trial-2400↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17852)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17865): Process ended prematurely: osmo-stp_10.42.42.5(pid=17865) [trial-2400↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17865)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=17875): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17875) [trial-2400↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17875)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17885): Process ended prematurely: osmo-stp_10.42.42.5(pid=17885) [trial-2400↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17885)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17899): Process ended prematurely: osmo-stp_10.42.42.5(pid=17899) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17899)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17910): Process ended prematurely: osmo-stp_10.42.42.5(pid=17910) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17910)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17927): Process ended prematurely: osmo-stp_10.42.42.5(pid=17927) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17927)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17938): Process ended prematurely: osmo-stp_10.42.42.5(pid=17938) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17938)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17952): Process ended prematurely: osmo-stp_10.42.42.5(pid=17952) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17952)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17963): Process ended prematurely: osmo-stp_10.42.42.5(pid=17963) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17963)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17977): Process ended prematurely: osmo-stp_10.42.42.5(pid=17977) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17977)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17988): Process ended prematurely: osmo-stp_10.42.42.5(pid=17988) [trial-2400↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17988)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18002): Process ended prematurely: osmo-stp_10.42.42.5(pid=18002) [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18002)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18013): Process ended prematurely: osmo-stp_10.42.42.5(pid=18013) [trial-2400↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18013)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18027): Process ended prematurely: osmo-stp_10.42.42.5(pid=18027) [trial-2400↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18027)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18038): Process ended prematurely: osmo-stp_10.42.42.5(pid=18038) [trial-2400↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18038)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18056): Process ended prematurely: osmo-stp_10.42.42.5(pid=18056) [trial-2400↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18056)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=18070): Process ended prematurely: osmo-stp_10.42.42.5(pid=18070) [trial-2400↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18070)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=18088): Process ended prematurely: osmo-stp_10.42.42.5(pid=18088) [trial-2400↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18088)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18098): Process ended prematurely: osmo-stp_10.42.42.5(pid=18098) [trial-2400↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18098)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18108): Process ended prematurely: osmo-stp_10.42.42.5(pid=18108) [trial-2400↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18108)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18125): Process ended prematurely: osmo-stp_10.42.42.5(pid=18125) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18125)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18138): Process ended prematurely: osmo-stp_10.42.42.5(pid=18138) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18138)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=18156): Process ended prematurely: osmo-stp_10.42.42.5(pid=18156) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18156)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18166): Process ended prematurely: osmo-stp_10.42.42.5(pid=18166) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18166)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18176): Process ended prematurely: osmo-stp_10.42.42.5(pid=18176) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18176)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18193): Process ended prematurely: osmo-stp_10.42.42.5(pid=18193) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18193)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=18209): Process ended prematurely: osmo-stp_10.42.42.5(pid=18209) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18209)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=18227): Process ended prematurely: osmo-stp_10.42.42.5(pid=18227) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18227)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18238): Process ended prematurely: osmo-stp_10.42.42.5(pid=18238) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18238)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18248): Process ended prematurely: osmo-stp_10.42.42.5(pid=18248) [trial-2400↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18248)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18264): Process ended prematurely: osmo-stp_10.42.42.5(pid=18264) [trial-2400↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18264)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18277): Process ended prematurely: osmo-stp_10.42.42.5(pid=18277) [trial-2400↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18286): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18286) [trial-2400↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18286)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18296): Process ended prematurely: osmo-stp_10.42.42.5(pid=18296) [trial-2400↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18296)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18310): Process ended prematurely: osmo-stp_10.42.42.5(pid=18310) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18310)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18321): Process ended prematurely: osmo-stp_10.42.42.5(pid=18321) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18321)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18335): Process ended prematurely: osmo-stp_10.42.42.5(pid=18335) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18335)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18346): Process ended prematurely: osmo-stp_10.42.42.5(pid=18346) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18346)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18361): Process ended prematurely: osmo-stp_10.42.42.5(pid=18361) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18361)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18372): Process ended prematurely: osmo-stp_10.42.42.5(pid=18372) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18372)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18387): Process ended prematurely: osmo-stp_10.42.42.5(pid=18387) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18398): Process ended prematurely: osmo-stp_10.42.42.5(pid=18398) [trial-2400↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18398)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18414): Process ended prematurely: osmo-stp_10.42.42.5(pid=18414) [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18414)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18425): Process ended prematurely: osmo-stp_10.42.42.5(pid=18425) [trial-2400↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18425)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18439): Process ended prematurely: osmo-stp_10.42.42.5(pid=18439) [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18450): Process ended prematurely: osmo-stp_10.42.42.5(pid=18450) [trial-2400↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18450)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18464): Process ended prematurely: osmo-stp_10.42.42.5(pid=18464) [trial-2400↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18464)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18475): Process ended prematurely: osmo-stp_10.42.42.5(pid=18475) [trial-2400↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18475)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=18764): Process ended prematurely: osmo-stp_10.42.42.5(pid=18764) [trial-2400↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] FAIL: iperf3.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18776): Process ended prematurely: osmo-stp_10.42.42.5(pid=18776) [trial-2400↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18776)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18795): Process ended prematurely: osmo-stp_10.42.42.5(pid=18795) [trial-2400↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18795)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18805): Process ended prematurely: osmo-stp_10.42.42.5(pid=18805) [trial-2400↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18805)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18816): Process ended prematurely: osmo-stp_10.42.42.5(pid=18816) [trial-2400↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18837): Process ended prematurely: osmo-stp_10.42.42.5(pid=18837) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18837)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18849): Process ended prematurely: osmo-stp_10.42.42.5(pid=18849) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18849)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18867): Process ended prematurely: osmo-stp_10.42.42.5(pid=18867) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18878): Process ended prematurely: osmo-stp_10.42.42.5(pid=18878) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18878)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18888): Process ended prematurely: osmo-stp_10.42.42.5(pid=18888) [trial-2400↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18888)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18905): Process ended prematurely: osmo-stp_10.42.42.5(pid=18905) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18917): Process ended prematurely: osmo-stp_10.42.42.5(pid=18917) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18917)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=18935): Process ended prematurely: osmo-stp_10.42.42.5(pid=18935) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18935)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18945): Process ended prematurely: osmo-stp_10.42.42.5(pid=18945) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18945)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=18963): Process ended prematurely: osmo-stp_10.42.42.5(pid=18963) [trial-2400↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18963)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18980): Process ended prematurely: osmo-stp_10.42.42.5(pid=18980) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18980)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18992): Process ended prematurely: osmo-stp_10.42.42.5(pid=18992) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18992)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19010): Process ended prematurely: osmo-stp_10.42.42.5(pid=19010) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19010)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19020): Process ended prematurely: osmo-stp_10.42.42.5(pid=19020) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19020)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19030): Process ended prematurely: osmo-stp_10.42.42.5(pid=19030) [trial-2400↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19030)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19043): Process ended prematurely: osmo-stp_10.42.42.5(pid=19043) [trial-2400↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19043)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=19051): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19051) [trial-2400↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19051)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=19053): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19053) [trial-2400↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19053)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=19055): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19055) [trial-2400↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19055)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=19057): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19057) [trial-2400↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19057)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=19067): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19067) [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)] FAIL: esme_connect_policy_closed.py (6.5 sec) Error: osmo-hlr_10.42.42.2(pid=19078): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19078) [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] FAIL: esme_ms_sms_transaction.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19115): Process ended prematurely: osmo-stp_10.42.42.5(pid=19115) [trial-2400↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19126): Process ended prematurely: osmo-stp_10.42.42.5(pid=19126) [trial-2400↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19126)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19137): Process ended prematurely: osmo-stp_10.42.42.5(pid=19137) [trial-2400↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19137)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19148): Process ended prematurely: osmo-stp_10.42.42.5(pid=19148) [trial-2400↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19148)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.5 sec) Error: srsepc(pid=19169): Process ended prematurely: srsepc(pid=19169) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19169)] FAIL: iperf3_bidir.py (19.4 sec) Error: srsepc(pid=19188): Process ended prematurely: srsepc(pid=19188) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19188)] FAIL: iperf3_dl.py (19.0 sec) Error: srsepc(pid=19204): Process ended prematurely: srsepc(pid=19204) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19204)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=19223): Process ended prematurely: srsepc(pid=19223) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19223)] FAIL: ping.py (18.6 sec) Error: srsepc(pid=19239): Process ended prematurely: srsepc(pid=19239) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19239)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=19255): Process ended prematurely: srsepc(pid=19255) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19255)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=19271): Process ended prematurely: srsepc(pid=19271) [trial-2400↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19271)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19286): Process ended prematurely: osmo-stp_10.42.42.5(pid=19286) [trial-2400↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19286)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19300): Process ended prematurely: osmo-stp_10.42.42.5(pid=19300) [trial-2400↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19300)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=19314): Process ended prematurely: osmo-stp_10.42.42.5(pid=19314) [trial-2400↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19314)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19328): Process ended prematurely: osmo-stp_10.42.42.5(pid=19328) [trial-2400↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19328)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19344): Process ended prematurely: osmo-stp_10.42.42.5(pid=19344) [trial-2400↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19344)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19358): Process ended prematurely: osmo-stp_10.42.42.5(pid=19358) [trial-2400↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19358)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19372): Process ended prematurely: osmo-stp_10.42.42.5(pid=19372) [trial-2400↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19372)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=19386): Process ended prematurely: osmo-stp_10.42.42.5(pid=19386) [trial-2400↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19386)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19400): Process ended prematurely: osmo-stp_10.42.42.5(pid=19400) [trial-2400↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19400)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19414): Process ended prematurely: osmo-stp_10.42.42.5(pid=19414) [trial-2400↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19414)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19428): Process ended prematurely: osmo-stp_10.42.42.5(pid=19428) [trial-2400↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19428)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19442): Process ended prematurely: osmo-stp_10.42.42.5(pid=19442) [trial-2400↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19442)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19456): Process ended prematurely: osmo-stp_10.42.42.5(pid=19456) [trial-2400↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19456)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19470): Process ended prematurely: osmo-stp_10.42.42.5(pid=19470) [trial-2400↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19470)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19485): Process ended prematurely: osmo-stp_10.42.42.5(pid=19485) [trial-2400↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19485)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19502): Process ended prematurely: osmo-stp_10.42.42.5(pid=19502) [trial-2400↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19502)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19516): Process ended prematurely: osmo-stp_10.42.42.5(pid=19516) [trial-2400↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19516)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19530): Process ended prematurely: osmo-stp_10.42.42.5(pid=19530) [trial-2400↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19530)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19544): Process ended prematurely: osmo-stp_10.42.42.5(pid=19544) [trial-2400↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19544)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19558): Process ended prematurely: osmo-stp_10.42.42.5(pid=19558) [trial-2400↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19558)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19573): Process ended prematurely: osmo-stp_10.42.42.5(pid=19573) [trial-2400↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19573)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19587): Process ended prematurely: osmo-stp_10.42.42.5(pid=19587) [trial-2400↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19587)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19601): Process ended prematurely: osmo-stp_10.42.42.5(pid=19601) [trial-2400↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19601)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19615): Process ended prematurely: osmo-stp_10.42.42.5(pid=19615) [trial-2400↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19615)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19630): Process ended prematurely: osmo-stp_10.42.42.5(pid=19630) [trial-2400↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19630)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=19644): Process ended prematurely: osmo-stp_10.42.42.5(pid=19644) [trial-2400↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19644)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19658): Process ended prematurely: osmo-stp_10.42.42.5(pid=19658) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19658)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19672): Process ended prematurely: osmo-stp_10.42.42.5(pid=19672) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19672)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19686): Process ended prematurely: osmo-stp_10.42.42.5(pid=19686) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19686)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19700): Process ended prematurely: osmo-stp_10.42.42.5(pid=19700) [trial-2400↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19700)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=19714): Process ended prematurely: osmo-stp_10.42.42.5(pid=19714) [trial-2400↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19714)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19728): Process ended prematurely: osmo-stp_10.42.42.5(pid=19728) [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19728)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19748): Process ended prematurely: osmo-stp_10.42.42.5(pid=19748) [trial-2400↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19748)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19762): Process ended prematurely: osmo-stp_10.42.42.5(pid=19762) [trial-2400↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19762)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19779): Process ended prematurely: osmo-stp_10.42.42.5(pid=19779) [trial-2400↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19779)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19793): Process ended prematurely: osmo-stp_10.42.42.5(pid=19793) [trial-2400↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19793)] + rm -rf trial-2400/inst + cd trial-2400 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 05:28:20 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400-run.tgz run.2022-12-14_05-28-31 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17686.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2994.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3912.tgz osmo-pcu-sysmo.build-5195.tgz osmo-pcu.build-5156.tgz osmo-sgsn.build-30101.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE